-- Logs begin at Mon 2022-09-19 14:13:44 UTC, end at Mon 2022-09-19 15:58:41 UTC. -- Sep 19 14:48:26.021957 dv-cinder-756711-11-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 14:48:26.031501 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 14:48:26 2022] *** Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: nodename: dv-cinder-756711-11-iscsi Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: machine: x86_64 Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: clock source: unix Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: pcre jit disabled Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: detected number of CPU cores: 4 Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: current working directory: / Sep 19 14:48:26.033434 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: detected binary path: /usr/bin/uwsgi-core Sep 19 14:48:26.034071 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: your processes number limit is 47680 Sep 19 14:48:26.034071 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: your memory page size is 4096 bytes Sep 19 14:48:26.034071 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: detected max file descriptor number: 2048 Sep 19 14:48:26.034071 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: lock engine: pthread robust mutexes Sep 19 14:48:26.034071 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: thunder lock: enabled Sep 19 14:48:26.034071 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 14:48:26.034071 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 14:48:26.073617 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: Python main interpreter initialized at 0x55af37f759c0 Sep 19 14:48:26.073617 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: python threads support enabled Sep 19 14:48:26.073617 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: your server socket listen backlog is limited to 100 connections Sep 19 14:48:26.073617 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: your mercy for graceful operations on workers is 90 seconds Sep 19 14:48:26.073992 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 14:48:26.074080 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: *** Operational MODE: preforking *** Sep 19 14:48:26.074317 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: *** uWSGI is running in multiple interpreter mode *** Sep 19 14:48:26.074317 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: spawned uWSGI master process (pid: 81630) Sep 19 14:48:26.074527 dv-cinder-756711-11-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 19 14:48:26.075384 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: spawned uWSGI worker 1 (pid: 81643, cores: 1) Sep 19 14:48:26.075384 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: spawned uWSGI worker 2 (pid: 81644, cores: 1) Sep 19 14:48:26.075538 dv-cinder-756711-11-iscsi devstack@keystone.service[81630]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 14:48:30.480529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:48:30.480529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: from cryptography.utils import int_from_bytes Sep 19 14:48:30.481336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:48:30.481336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: from cryptography.utils import int_from_bytes Sep 19 14:48:30.481612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:48:30.481612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: from cryptography.utils import int_from_bytes Sep 19 14:48:30.482071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:48:30.482071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: from cryptography.utils import int_from_bytes Sep 19 14:48:30.532118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:48:30.532315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:48:30.532403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:48:30.532525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:48:30.532609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] command line args: [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:48:30.532687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] command line args: [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:48:30.532763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:48:30.532932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ================================================================================ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:48:30.533024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:48:30.533102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ================================================================================ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:48:30.533183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] admin_token = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.533355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] admin_token = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.533440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] config_dir = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.533593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.533683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] config_dir = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.533781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] config_source = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.533865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.533942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] config_source = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] debug = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] debug = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.534988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] log_config_append = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] log_config_append = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.535988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] log_dir = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] log_dir = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] log_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] log_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.536988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537565 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.537938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.538015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.538147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.538285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.538404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.538535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.538678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.538828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.538955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.539139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.539139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.539343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.539420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.539540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.539671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.539901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.540085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] publish_errors = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.540288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.540521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.540632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] publish_errors = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.540771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.540882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.540957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] standard_threads = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] standard_threads = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.541912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] use_journal = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] use_json = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] use_stderr = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] use_journal = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] use_syslog = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] use_json = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.542980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] use_stderr = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.543055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] use_syslog = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.543132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.543270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:48:30.543350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.543530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.543608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.543772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.543894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.544034 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.544113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.544270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.544345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.544543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.544638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.544780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.544863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.545996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.546079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.546231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.546306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.546479 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.546560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.546717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.546801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.546951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.547078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.547206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.547283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.547432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.547509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.547689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.547766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.547926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.548007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.548179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.548262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.548419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.548512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.548702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.548781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.548969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549047 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.549979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.550127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.550203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.550516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.550602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.550602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.550715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.550810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.550896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.551988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.552104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.552185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.552266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.552422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.552546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.552681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.552762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.552918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.553001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.553149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.553238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.553379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.553458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.553608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.553736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.554387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.554551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.554753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.554885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.555129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.555242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.555409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.555509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.555605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.555684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.555841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.555920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.556091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.556178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.556323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.556402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.556587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.556672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.556805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.556884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.557980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.558063 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.558215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.558294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.558459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.558557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.558689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.558780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.558926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.559933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.560095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.560180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.560334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.560425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.560611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.560692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.560858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.560948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.561095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.561175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.561332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.561412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.561566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.561644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.561804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.561882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.562991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.563068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.563231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.563335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.563500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.563582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.563697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.563773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.563930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.564993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.565152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.565229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.565387 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.565466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.565628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.565709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.565864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.565941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.566097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.566175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.566332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.566417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.566562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.566647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.566795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.566872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.567944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.568072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.568186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.568264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.568424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.568599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.568698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.568776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.568939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.569017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.569183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.569263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.569481 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.external = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.570145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.570290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.570419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.570552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.external = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.570701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.570860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.570998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.password = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.token = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.password = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.token = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.571970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.572061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.572200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.572280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.572446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.572545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.572703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.572796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.572937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.573968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.574135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.574289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.574366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.574439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.574604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.574683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.574843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.574929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.575080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.575166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.575317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.575396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.575568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.575653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.575806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.575893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.576060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.576140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.576333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.576419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.576600 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.576681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.576860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.576941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.577097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.577185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.577335 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.577414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.577573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.577657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.577813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.577900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.578040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.578184 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.578289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.578376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.578517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.578604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.578766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.578846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.579967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.580054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.580212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.580291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.580446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.580572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.580712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.580801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.580948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581182 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.581958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.582120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.582208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.582354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.582432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.582586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.582665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.582816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.582897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.583046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.583132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.583279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.583360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.583524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.583667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.583771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.583851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.584013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.584092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.584266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.584352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.584528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.584611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.584770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.584850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.585972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.586053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.586211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.586298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.586704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.586791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.586943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.587022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.587191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.587270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.587436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.587515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.587687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.587823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.587959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.588036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.588185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.588267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.588424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.588572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.588698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.588824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.588963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.589088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.589212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.589337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.589476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.589602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.589736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.589862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.589987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.590112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.590233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.590360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.590494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.590620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.590620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.590853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.590979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.591111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.591254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.591380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.591505 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.591630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.591767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.591893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.591893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.592137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.592262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.592386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.592529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.592652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.592791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.592923 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.593052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.593177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.593299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.593423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.593557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.593681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.593814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.593939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.594070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.594202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.594326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.594449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.594573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.594709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.594833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.594968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.595092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.595216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.595340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.595464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.595588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.595722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.595845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.595970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.596096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.596218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.596351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.596541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.596665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.596793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.596918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.597042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.597166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.597302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.597428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.597553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.597677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.597802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.597928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.598131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.598275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.598400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.598524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.598649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.598774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.598910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.599035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.599160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.599285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.599409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.599533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.599668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.599794 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.599919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.600054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.600180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.600306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.600442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.600542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.600813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.600981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.601181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.601395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.601585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.601720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.601846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.601974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.602110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.602237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.602374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.602498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.602498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.602827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.602957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.603082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.603218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.603341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.603466 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.603589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.603716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.603839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.603982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.604109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.604234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.604361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.604537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.604661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.604802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.614253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.614406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.614538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.614665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] role.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.614795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.614937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] role.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.615067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.615207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.615336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.615462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.615590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] role.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.615726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.615854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] role.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.615981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.616107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.616235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.616840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.616919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.616983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.617044 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.617189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.617316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.617441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.617584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.617711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.617838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.617961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.618997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.619235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.619359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.619484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.619608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.619741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.619741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.619977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.620101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.620226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.620349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.620526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.620662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.620789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.620916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.621042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.621226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.621384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.621520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.621649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.621777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.621777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.622020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.622158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.622282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.622420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.622547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.622674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.622800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.622800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.623051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.623304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.623304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.623550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.623677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.623803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.623929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] token.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.624066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.624193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.624327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.624453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.624599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.624721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.624803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.624919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.625052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] token.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.625177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.625299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.625420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.625541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.625664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.625803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.625927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.626048 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.626171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.626294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.626416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.626544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.626669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.626790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.626912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.627035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.627156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.627287 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.627410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.627542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.627665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.627796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.627927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.628050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.628172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.628303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.628426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.628522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.628686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.628812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.628950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.629168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.629313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.629439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.629563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.629686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.629810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.629810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.630050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.630174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.630297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.630421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.630544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.630666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.630797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.631109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.631248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.631374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.631457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.631574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.631705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.631834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.632004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.632684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.632853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.633023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.633158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.633242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.633361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.633487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.633623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.633751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.633751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:48:30.634003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.634003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.634003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.634003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.634003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.634003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:48:30.634003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:48:30.656021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.656285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.656458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.656869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.657105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.657334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.665386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.668460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.695854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.696088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.696367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.696626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.750155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.750732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.799238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.799472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.801104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.801345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.957830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.958943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.959104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.982680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.982879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.982976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983781 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.983994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.984073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.984208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.996106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:30.996605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.009739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.009902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.010114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.010342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.010598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.010827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.011043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.013568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.013810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.014043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.014274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.014501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.014722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.014941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:48:31.031011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.031223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:48:31.031573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.031777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:48:31.032060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.032332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.032630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.032873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.032956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.033092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:48:31.033441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.033644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:48:31.033922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.034188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.034457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.034719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.043412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.043699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.043978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.044270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.045003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.045290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.045828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.045828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.051410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.052799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.054962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.055363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.055737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.056124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.056442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.056586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.056716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.056822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.056996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.057080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.057275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.057358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.057554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.057637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.057820 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.057903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.058096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.058178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.058377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.058652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.058929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.059203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.081003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.081735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.082488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.082777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.083202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.083492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.087869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.088158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.088449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.088551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.088778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.089067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.095405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.095697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.096708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.097004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.102087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.102383 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.102672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.102960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.103242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.103357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.103532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.103658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.103804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.103900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.104079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.104168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.104446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.104758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.105043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.105329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.120235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.120539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.121404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.121691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.124397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.125596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.127644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.127947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.128852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.129158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.132261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.133528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.135501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.136754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.138735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.139040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.139329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.139625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.139911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.139995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.140209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.140313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.140601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.140894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.141189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.141488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.156068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.156368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.156664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.156931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.157435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.157729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.158003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.158273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.164334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.165897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.165984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.167427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.167510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.167716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.169014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.169317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.170439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.170731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.171022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.171308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.171704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.171962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.172253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.172579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.172870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.173304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.183029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.183315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.183603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.183889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.184279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.184613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.184721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.184894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.184978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.185225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.185513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.185896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.186211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.186496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.200332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.201932 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.203234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.204896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.206131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.207614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.207872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.209100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.209365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.209446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.209769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.211710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.212010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.212416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.216947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.218424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.218813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.220278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.221316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.221716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.222010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.222296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.223202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.223607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.223904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.224189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.230644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.230949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.231241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.232756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.233055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.233345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.238103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.238393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.238681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.238964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.239244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.239523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.239810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.240105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.240215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:48:31.240380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.240528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.240680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.240843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.240964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.241085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.241253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.241393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.241519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.241671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.241804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.241958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.242259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.242539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.242815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.243099 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.243382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.243757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.244036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:48:31.276153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55af37f759c0 pid: 81643 (default app) Sep 19 14:48:31.279148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55af37f759c0 pid: 81644 (default app) Sep 19 14:48:31.279428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d5088-acbb-4111-b749-06e7fc8f46b1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:31.279716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d5088-acbb-4111-b749-06e7fc8f46b1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:31.279991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d5088-acbb-4111-b749-06e7fc8f46b1 None None] PATH_INFO: `/v3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:31.284138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 791 bytes} [Mon Sep 19 14:48:31 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:39.636293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d71fa2-bfdc-459d-80d4-eee27606304e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:39.636857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d71fa2-bfdc-459d-80d4-eee27606304e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:39.636857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d71fa2-bfdc-459d-80d4-eee27606304e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:39.641175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:39.646810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:39.647281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:39.647379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:39.721612 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: INFO dbcounter [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] Registered counter for database keystone Sep 19 14:48:39.744004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG oslo_db.sqlalchemy.engines [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:48:39.750509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writer thread running {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:48:39.936727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG passlib.handlers.bcrypt [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81643) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 14:48:39.937031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG passlib.handlers.bcrypt [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81643) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 14:48:39.998240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:39.999875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:40.136321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 14:48:40.612745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d71fa2-bfdc-459d-80d4-eee27606304e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:40.682984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: INFO dbcounter [None req-21d71fa2-bfdc-459d-80d4-eee27606304e None None] Registered counter for database keystone Sep 19 14:48:40.702268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG oslo_db.sqlalchemy.engines [None req-21d71fa2-bfdc-459d-80d4-eee27606304e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:48:40.708466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writer thread running {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:48:40.829009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d71fa2-bfdc-459d-80d4-eee27606304e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:40.833195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46b641-cb4c-4573-a990-f278f32afc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:40.833830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46b641-cb4c-4573-a990-f278f32afc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:40.834115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46b641-cb4c-4573-a990-f278f32afc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:40.834393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46b641-cb4c-4573-a990-f278f32afc08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:40.843089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46b641-cb4c-4573-a990-f278f32afc08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:40.894312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd46b641-cb4c-4573-a990-f278f32afc08 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 14:48:40.894636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46b641-cb4c-4573-a990-f278f32afc08 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:40.905038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1324 bytes} [Mon Sep 19 14:48:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 14:48:40.911165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:40.928365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d93057-94bd-49e8-a3bd-efa64872d338 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:40.933666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efcc28-0f5e-4992-8349-f83111ce71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:40.934838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcc28-0f5e-4992-8349-f83111ce71d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:40.935129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcc28-0f5e-4992-8349-f83111ce71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:40.935411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcc28-0f5e-4992-8349-f83111ce71d5 admin admin] PATH_INFO: `/v3/projects/9905c16dd71145d6a307772e4fe88d81` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:40.937066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efcc28-0f5e-4992-8349-f83111ce71d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=9905c16dd71145d6a307772e4fe88d81)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:40.990927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b5efcc28-0f5e-4992-8349-f83111ce71d5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 14:48:40.991267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efcc28-0f5e-4992-8349-f83111ce71d5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:40.995809 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 3/5] 10.222.0.75 () {56 vars in 1207 bytes} [Mon Sep 19 14:48:40 2022] GET /identity/v3/projects/9905c16dd71145d6a307772e4fe88d81 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:43.155275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b98576-5db0-4d16-a8e3-80dc54f7fd71 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:43.155791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b98576-5db0-4d16-a8e3-80dc54f7fd71 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:43.155878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b98576-5db0-4d16-a8e3-80dc54f7fd71 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:43.159906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 3/6] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:43.165831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5216d6-d453-4565-ac06-fafc4df2be81 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:43.166238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5216d6-d453-4565-ac06-fafc4df2be81 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:43.166353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5216d6-d453-4565-ac06-fafc4df2be81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:43.187107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1f5216d6-d453-4565-ac06-fafc4df2be81 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:43.188679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1f5216d6-d453-4565-ac06-fafc4df2be81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:43.196826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 14:48:43.468858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b98576-5db0-4d16-a8e3-80dc54f7fd71 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:43.481546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b98576-5db0-4d16-a8e3-80dc54f7fd71 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:43.485786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd994873-fe2d-4c0f-814d-219fc4ceeaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:43.486385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd994873-fe2d-4c0f-814d-219fc4ceeaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:43.486668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd994873-fe2d-4c0f-814d-219fc4ceeaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:43.486944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd994873-fe2d-4c0f-814d-219fc4ceeaa8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:43.495159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd994873-fe2d-4c0f-814d-219fc4ceeaa8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:43.496963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd994873-fe2d-4c0f-814d-219fc4ceeaa8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:43.505713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1324 bytes} [Mon Sep 19 14:48:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:48:43.512048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5216d6-d453-4565-ac06-fafc4df2be81 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:43.521397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5216d6-d453-4565-ac06-fafc4df2be81 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:43.525796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c4a99-1fba-4081-8bc6-d27f61b1a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:43.526432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4a99-1fba-4081-8bc6-d27f61b1a8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:43.526715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4a99-1fba-4081-8bc6-d27f61b1a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:43.526993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4a99-1fba-4081-8bc6-d27f61b1a8d1 admin admin] PATH_INFO: `/v3/users/46687a8108714da08b34f26401622753` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:43.528346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c4a99-1fba-4081-8bc6-d27f61b1a8d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=46687a8108714da08b34f26401622753)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:43.530265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c4a99-1fba-4081-8bc6-d27f61b1a8d1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:43.531798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 5/9] 10.222.0.75 () {56 vars in 1198 bytes} [Mon Sep 19 14:48:43 2022] GET /identity/v3/users/46687a8108714da08b34f26401622753 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:45.777688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3edba-a125-4f54-830f-d041035eddb5 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:45.778118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3edba-a125-4f54-830f-d041035eddb5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:45.778235 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3edba-a125-4f54-830f-d041035eddb5 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:45.779571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:45.784850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ea98-8197-48bf-8a8c-a5ce0a886755 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:45.785252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ea98-8197-48bf-8a8c-a5ce0a886755 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:45.785393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ea98-8197-48bf-8a8c-a5ce0a886755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:45.805977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d0f1ea98-8197-48bf-8a8c-a5ce0a886755 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:45.807170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d0f1ea98-8197-48bf-8a8c-a5ce0a886755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:45.848759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f927b-4317-4efa-af3a-51088cb30099 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:45.849043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f927b-4317-4efa-af3a-51088cb30099 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:45.849322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f927b-4317-4efa-af3a-51088cb30099 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:45.850639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 6/11] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:48:45.856784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:45.857070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:45.857345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:45.892055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 6/12] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:45.901107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG passlib.handlers.bcrypt [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81644) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 14:48:45.901498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG passlib.handlers.bcrypt [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81644) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 14:48:45.951684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:45.953309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:46.054543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 7/13] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:48:46.169319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ea98-8197-48bf-8a8c-a5ce0a886755 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.194967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:46.277302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ea98-8197-48bf-8a8c-a5ce0a886755 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.310789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2b41e-f316-49f4-8fb1-e0ce9d32c6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:46.311346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b41e-f316-49f4-8fb1-e0ce9d32c6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:46.311628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b41e-f316-49f4-8fb1-e0ce9d32c6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:46.311904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b41e-f316-49f4-8fb1-e0ce9d32c6d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:46.323244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2b41e-f316-49f4-8fb1-e0ce9d32c6d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-08a2b41e-f316-49f4-8fb1-e0ce9d32c6d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:48:46.331906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:48:46.332874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:48:46.333639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 7/14] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:48:46.339066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.339720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2b41e-f316-49f4-8fb1-e0ce9d32c6d8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.421806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:46.439423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2b41e-f316-49f4-8fb1-e0ce9d32c6d8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.441975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e62313-0d2e-467c-bfe9-f3c21adfc47a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.444777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:46.475422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:46.476036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:46.476894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:46.477229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:46.477904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:48:46.478239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:46.479687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:46.481214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168eb9-d307-4662-b370-98e240e93b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:46.482086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168eb9-d307-4662-b370-98e240e93b55 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:46.482371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168eb9-d307-4662-b370-98e240e93b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:46.482649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168eb9-d307-4662-b370-98e240e93b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:46.491974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 8/15] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:48:46.497584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.559848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168eb9-d307-4662-b370-98e240e93b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:46.561460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168eb9-d307-4662-b370-98e240e93b55 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:46.617972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f9fe9-4e8d-4191-a7e0-2558117ccda7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.659723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c081fb-f7f7-4d84-bf50-7c77599facc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:46.660372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c081fb-f7f7-4d84-bf50-7c77599facc4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:46.660689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c081fb-f7f7-4d84-bf50-7c77599facc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:46.660968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c081fb-f7f7-4d84-bf50-7c77599facc4 None admin] PATH_INFO: `/v3/users/46687a8108714da08b34f26401622753` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:46.662134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c081fb-f7f7-4d84-bf50-7c77599facc4 None admin] RBAC: Authorizing `identity:get_user(user_id=46687a8108714da08b34f26401622753)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:46.663110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 8/16] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:48:46.663685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c081fb-f7f7-4d84-bf50-7c77599facc4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:46.665577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 9/17] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/users/46687a8108714da08b34f26401622753 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:48:46.668756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168eb9-d307-4662-b370-98e240e93b55 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.670909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c081fb-f7f7-4d84-bf50-7c77599facc4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.671650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:46.686916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:46.770111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168eb9-d307-4662-b370-98e240e93b55 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.778844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c081fb-f7f7-4d84-bf50-7c77599facc4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.806602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:46.807474 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:46.807754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:46.808028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:46.812858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640fba-1459-46b4-8775-4801b70482f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:46.813503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640fba-1459-46b4-8775-4801b70482f6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:46.813783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640fba-1459-46b4-8775-4801b70482f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:46.814054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc640fba-1459-46b4-8775-4801b70482f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:46.815173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc640fba-1459-46b4-8775-4801b70482f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:46.816668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc640fba-1459-46b4-8775-4801b70482f6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:46.818196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 10/18] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:48:46.824807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640fba-1459-46b4-8775-4801b70482f6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.827970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:46.829461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:48:46.853851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:48:46.854892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:48:46.855886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:48:46.855886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:48:46.855886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:48:46.855886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 9/19] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:48:46.860743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:46.909083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:46.918609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:46.927832 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc640fba-1459-46b4-8775-4801b70482f6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.963604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d45f4b-be50-4fea-9837-e4c0bf6ea2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:46.964211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45f4b-be50-4fea-9837-e4c0bf6ea2dc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:46.964516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45f4b-be50-4fea-9837-e4c0bf6ea2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:46.964787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45f4b-be50-4fea-9837-e4c0bf6ea2dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:46.965511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d45f4b-be50-4fea-9837-e4c0bf6ea2dc None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.domain.id=default, user.id=46687a8108714da08b34f26401622753) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:48:46.965598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2613e11-c071-4627-8eba-9cbdfd20ea59 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:46.965813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d45f4b-be50-4fea-9837-e4c0bf6ea2dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:46.967249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d45f4b-be50-4fea-9837-e4c0bf6ea2dc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:46.973894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 11/20] 10.222.0.75 () {56 vars in 1322 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/role_assignments?user.id=46687a8108714da08b34f26401622753&scope.domain.id=default&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:48:47.003309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3167a-7d22-4b22-bae2-00cdd4a03e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:47.003953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3167a-7d22-4b22-bae2-00cdd4a03e68 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:47.004238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3167a-7d22-4b22-bae2-00cdd4a03e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:47.004542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3167a-7d22-4b22-bae2-00cdd4a03e68 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:47.005288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3167a-7d22-4b22-bae2-00cdd4a03e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:48:47.005598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3167a-7d22-4b22-bae2-00cdd4a03e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:47.007116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3167a-7d22-4b22-bae2-00cdd4a03e68 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:47.027079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 10/21] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:48:49.328506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e136a-a282-42ea-8744-ae987ece34d4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:49.328506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e136a-a282-42ea-8744-ae987ece34d4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:49.328506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e136a-a282-42ea-8744-ae987ece34d4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:49.328506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 12/22] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:49.530432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a6f0-1597-4d00-ac53-9286a73ef768 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:49.530432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a6f0-1597-4d00-ac53-9286a73ef768 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:49.530432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a6f0-1597-4d00-ac53-9286a73ef768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:49.530432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f056a6f0-1597-4d00-ac53-9286a73ef768 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:49.530432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f056a6f0-1597-4d00-ac53-9286a73ef768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:49.530432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 11/23] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:48:50.038536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e136a-a282-42ea-8744-ae987ece34d4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:50.178634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e136a-a282-42ea-8744-ae987ece34d4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:50.219241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719be465-8667-43ef-b9ff-4148a2ca7a0b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.219937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719be465-8667-43ef-b9ff-4148a2ca7a0b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.220414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719be465-8667-43ef-b9ff-4148a2ca7a0b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.222283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 12/24] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:50.229122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6d70-fc3f-427e-b0e7-2cc51170ece3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.229489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6d70-fc3f-427e-b0e7-2cc51170ece3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.229858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6d70-fc3f-427e-b0e7-2cc51170ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.233183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513be57-34a4-412b-ad60-80944ef4c99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:50.233840 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513be57-34a4-412b-ad60-80944ef4c99f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.234120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513be57-34a4-412b-ad60-80944ef4c99f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.234395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513be57-34a4-412b-ad60-80944ef4c99f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.259143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513be57-34a4-412b-ad60-80944ef4c99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5513be57-34a4-412b-ad60-80944ef4c99f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:48:50.264530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:48:50.265414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:48:50.266181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:48:50.266862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-206f6d70-fc3f-427e-b0e7-2cc51170ece3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:50.266862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-206f6d70-fc3f-427e-b0e7-2cc51170ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:50.269993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 13/25] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:48:50.271926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9d8a-87d1-431a-bd16-ae8985f82405 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.272213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9d8a-87d1-431a-bd16-ae8985f82405 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.272503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9d8a-87d1-431a-bd16-ae8985f82405 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.274404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 14/26] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:50.279132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9d8a-87d1-431a-bd16-ae8985f82405 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:50.287008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:50.362722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:50.396065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 13/27] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:48:50.402136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67caa9-3b55-413a-9bf2-57f1ac689f65 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.402267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67caa9-3b55-413a-9bf2-57f1ac689f65 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.402509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67caa9-3b55-413a-9bf2-57f1ac689f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.433646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7c67caa9-3b55-413a-9bf2-57f1ac689f65 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:50.434979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c67caa9-3b55-413a-9bf2-57f1ac689f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:50.438893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9d8a-87d1-431a-bd16-ae8985f82405 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:50.512874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:50.513497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.513779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.514052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.514718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:48:50.515018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:50.516419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:50.523007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 14/28] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:50.524391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc51b-5b1d-4d90-ad5f-bf439fd5ffce None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.524707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc51b-5b1d-4d90-ad5f-bf439fd5ffce None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.524990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc51b-5b1d-4d90-ad5f-bf439fd5ffce None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.526229 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 15/29] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:50.526961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 15/30] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:50.531669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574ac6-deed-4e5d-9f41-e9ed6b57e218 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.532142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574ac6-deed-4e5d-9f41-e9ed6b57e218 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.532218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574ac6-deed-4e5d-9f41-e9ed6b57e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.532415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:50.575001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5a574ac6-deed-4e5d-9f41-e9ed6b57e218 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:50.576225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5a574ac6-deed-4e5d-9f41-e9ed6b57e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:50.684529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:50.733821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 16/31] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:50.756432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267c492-524a-4e8e-9e35-389278e2d00f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:50.799786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a574ac6-deed-4e5d-9f41-e9ed6b57e218 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:50.825633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995ca7-b39b-455c-b8ae-7e5548e7a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:50.826279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995ca7-b39b-455c-b8ae-7e5548e7a42c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.826557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995ca7-b39b-455c-b8ae-7e5548e7a42c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.826834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995ca7-b39b-455c-b8ae-7e5548e7a42c None admin] PATH_INFO: `/v3/users/46687a8108714da08b34f26401622753` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.828103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8995ca7-b39b-455c-b8ae-7e5548e7a42c None admin] RBAC: Authorizing `identity:get_user(user_id=46687a8108714da08b34f26401622753)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:50.829610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8995ca7-b39b-455c-b8ae-7e5548e7a42c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:50.837884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 16/32] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:48:50 2022] GET /identity/v3/users/46687a8108714da08b34f26401622753 => generated 247 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:48:50.843147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995ca7-b39b-455c-b8ae-7e5548e7a42c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:50.883054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:51.004766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a574ac6-deed-4e5d-9f41-e9ed6b57e218 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:51.035627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995ca7-b39b-455c-b8ae-7e5548e7a42c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:51.070056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:51.070627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.070951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.071229 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.085038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:51.088249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:51.097949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc10e-9a45-48f6-88a6-b4c3585ed1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:51.098941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc10e-9a45-48f6-88a6-b4c3585ed1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.099825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc10e-9a45-48f6-88a6-b4c3585ed1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.100460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc10e-9a45-48f6-88a6-b4c3585ed1c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.102514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dc10e-9a45-48f6-88a6-b4c3585ed1c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:51.104189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dc10e-9a45-48f6-88a6-b4c3585ed1c2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:51.106016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 17/33] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:48:51.106638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:48:51.107711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:48:51.108830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:48:51.108830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:48:51.108830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:48:51.108830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 17/34] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:48:51.109835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc10e-9a45-48f6-88a6-b4c3585ed1c2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:51.113066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:51.113180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:51.223672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:51.240100 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bffd9-a233-420a-bedf-0c4dd2461221 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:51.245305 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc10e-9a45-48f6-88a6-b4c3585ed1c2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:51.282386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4780d-ddfc-4c17-8a55-44a30a920b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:51.282962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4780d-ddfc-4c17-8a55-44a30a920b03 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.283249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4780d-ddfc-4c17-8a55-44a30a920b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.283527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4780d-ddfc-4c17-8a55-44a30a920b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.284204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4780d-ddfc-4c17-8a55-44a30a920b03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:51.285629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4780d-ddfc-4c17-8a55-44a30a920b03 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:51.293475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f7c6-c814-4457-85c8-72ab14cb9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:51.294604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f7c6-c814-4457-85c8-72ab14cb9648 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.294963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f7c6-c814-4457-85c8-72ab14cb9648 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.295351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f7c6-c814-4457-85c8-72ab14cb9648 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.296087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31f7c6-c814-4457-85c8-72ab14cb9648 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:51.297584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31f7c6-c814-4457-85c8-72ab14cb9648 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:51.506360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 18/35] 10.222.0.75 () {60 vars in 1131 bytes} [Mon Sep 19 14:48:51 2022] POST /identity/v3/roles => generated 225 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:48:51.509778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4780d-ddfc-4c17-8a55-44a30a920b03 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:51.568771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 18/36] 10.222.0.75 () {60 vars in 1131 bytes} [Mon Sep 19 14:48:51 2022] POST /identity/v3/roles => generated 219 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:48:51.568771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f7c6-c814-4457-85c8-72ab14cb9648 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:51.656897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:51.707650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f7c6-c814-4457-85c8-72ab14cb9648 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:51.721454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4780d-ddfc-4c17-8a55-44a30a920b03 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:51.761246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b76718-f9bf-4daf-bcb9-ba44910b5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:51.761896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76718-f9bf-4daf-bcb9-ba44910b5cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.762184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76718-f9bf-4daf-bcb9-ba44910b5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.762467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76718-f9bf-4daf-bcb9-ba44910b5cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.763143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b76718-f9bf-4daf-bcb9-ba44910b5cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:48:51.763464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b76718-f9bf-4daf-bcb9-ba44910b5cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:51.765323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b76718-f9bf-4daf-bcb9-ba44910b5cf8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:51.779453 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8edc-e19e-4d12-af0f-1a51324b77c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:51.780347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8edc-e19e-4d12-af0f-1a51324b77c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.780662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8edc-e19e-4d12-af0f-1a51324b77c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.780938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8edc-e19e-4d12-af0f-1a51324b77c5 None admin] PATH_INFO: `/v3/domains/default/users/46687a8108714da08b34f26401622753/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.783584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8edc-e19e-4d12-af0f-1a51324b77c5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=46687a8108714da08b34f26401622753, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:51.785274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8edc-e19e-4d12-af0f-1a51324b77c5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:51.787278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 19/37] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:51.788547 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8cd41-50cb-425f-a3f5-757366ae08b1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.789353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8cd41-50cb-425f-a3f5-757366ae08b1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.789684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8cd41-50cb-425f-a3f5-757366ae08b1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.791075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 20/38] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:51.792134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213c2c-b7e7-4799-8db7-d0a236938713 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.792615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213c2c-b7e7-4799-8db7-d0a236938713 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.792857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74213c2c-b7e7-4799-8db7-d0a236938713 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.794285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 21/39] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:51.799567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b3b8-355e-4843-b82b-484393aaadaa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.799861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b3b8-355e-4843-b82b-484393aaadaa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.800146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b3b8-355e-4843-b82b-484393aaadaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.821857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4906b3b8-355e-4843-b82b-484393aaadaa None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:51.823348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4906b3b8-355e-4843-b82b-484393aaadaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:51.893132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 22/40] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:51.903455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906b3b8-355e-4843-b82b-484393aaadaa None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:51.903547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 19/41] 10.222.0.75 () {58 vars in 1361 bytes} [Mon Sep 19 14:48:51 2022] PUT /identity/v3/domains/default/users/46687a8108714da08b34f26401622753/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:48:51.903547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fa32-6bd2-4900-9461-dd50c55dd503 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.903547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fa32-6bd2-4900-9461-dd50c55dd503 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.903997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fa32-6bd2-4900-9461-dd50c55dd503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.930460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b9c5fa32-6bd2-4900-9461-dd50c55dd503 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:51.933119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b9c5fa32-6bd2-4900-9461-dd50c55dd503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:51.936159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:51.959395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:52.028756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906b3b8-355e-4843-b82b-484393aaadaa None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:52.030549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 20/42] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:52.069111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235405-288f-41c3-a131-f4aa60b20cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:52.070342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235405-288f-41c3-a131-f4aa60b20cee None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:52.070582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235405-288f-41c3-a131-f4aa60b20cee None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:52.070861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235405-288f-41c3-a131-f4aa60b20cee None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:52.071536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235405-288f-41c3-a131-f4aa60b20cee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:52.073271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235405-288f-41c3-a131-f4aa60b20cee None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:52.171631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5fa32-6bd2-4900-9461-dd50c55dd503 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:52.290818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5fa32-6bd2-4900-9461-dd50c55dd503 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:52.324582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 23/43] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:48:51 2022] POST /identity/v3/projects => generated 301 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:48:52.325335 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235405-288f-41c3-a131-f4aa60b20cee None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:52.331866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5e969-0b80-4815-9977-3b71265ea1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:52.332633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5e969-0b80-4815-9977-3b71265ea1e4 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:52.332995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5e969-0b80-4815-9977-3b71265ea1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:52.333346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5e969-0b80-4815-9977-3b71265ea1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:52.334117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5e969-0b80-4815-9977-3b71265ea1e4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:52.336278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5e969-0b80-4815-9977-3b71265ea1e4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:52.458433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235405-288f-41c3-a131-f4aa60b20cee None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:52.462683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:52.469171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 21/44] 10.222.0.75 () {60 vars in 1131 bytes} [Mon Sep 19 14:48:52 2022] POST /identity/v3/roles => generated 223 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:48:52.469631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:52.513788 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72979d1d-4d7f-4dab-8eb6-5bbb16269211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:52.514816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979d1d-4d7f-4dab-8eb6-5bbb16269211 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:52.515353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979d1d-4d7f-4dab-8eb6-5bbb16269211 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:52.515818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979d1d-4d7f-4dab-8eb6-5bbb16269211 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:52.517415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979d1d-4d7f-4dab-8eb6-5bbb16269211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:52.524726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979d1d-4d7f-4dab-8eb6-5bbb16269211 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:52.524726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 24/45] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:52.527694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5e969-0b80-4815-9977-3b71265ea1e4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:52.649428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5e969-0b80-4815-9977-3b71265ea1e4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:52.692276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a451e30-9ea1-4c4f-8aca-d82351906523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:52.692965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a451e30-9ea1-4c4f-8aca-d82351906523 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:52.693224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a451e30-9ea1-4c4f-8aca-d82351906523 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:52.693554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a451e30-9ea1-4c4f-8aca-d82351906523 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:52.694211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a451e30-9ea1-4c4f-8aca-d82351906523 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:52.695788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a451e30-9ea1-4c4f-8aca-d82351906523 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:52.829442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 22/46] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:48:52 2022] POST /identity/v3/projects => generated 312 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:48:54.160375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7852-8acd-4944-b7bf-0daa29e14878 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:54.160948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7852-8acd-4944-b7bf-0daa29e14878 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:54.161051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7852-8acd-4944-b7bf-0daa29e14878 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:54.162377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 25/47] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:54.167851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296122f8-0961-43a1-80dc-c0dedf86b68b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:54.168275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296122f8-0961-43a1-80dc-c0dedf86b68b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:54.168469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296122f8-0961-43a1-80dc-c0dedf86b68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:54.186308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-296122f8-0961-43a1-80dc-c0dedf86b68b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:54.187477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-296122f8-0961-43a1-80dc-c0dedf86b68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:54.236159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:54.256238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 23/48] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:54.525713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7852-8acd-4944-b7bf-0daa29e14878 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:54.628682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7852-8acd-4944-b7bf-0daa29e14878 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:54.665741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e3b7-bc10-43b4-8123-23649b37782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:54.666379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e3b7-bc10-43b4-8123-23649b37782c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:54.666670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e3b7-bc10-43b4-8123-23649b37782c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:54.666946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e3b7-bc10-43b4-8123-23649b37782c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:54.677001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384e3b7-bc10-43b4-8123-23649b37782c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6384e3b7-bc10-43b4-8123-23649b37782c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:48:54.682577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:48:54.683563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:48:54.684339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 26/49] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:48:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:48:54.689650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296122f8-0961-43a1-80dc-c0dedf86b68b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:54.789306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296122f8-0961-43a1-80dc-c0dedf86b68b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:54.823643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:54.824267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:54.824578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:54.824859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:54.825535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:48:54.825839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:54.827223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:54.840024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 24/50] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:48:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:54.846290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e3b7-bc10-43b4-8123-23649b37782c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:54.878516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:54.952891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e3b7-bc10-43b4-8123-23649b37782c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:54.987694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7767a7-2af0-40f7-9240-4732733f559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:54.988333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7767a7-2af0-40f7-9240-4732733f559d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:54.988653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7767a7-2af0-40f7-9240-4732733f559d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:54.988934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7767a7-2af0-40f7-9240-4732733f559d None admin] PATH_INFO: `/v3/users/46687a8108714da08b34f26401622753` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:54.990078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7767a7-2af0-40f7-9240-4732733f559d None admin] RBAC: Authorizing `identity:get_user(user_id=46687a8108714da08b34f26401622753)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:54.992165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7767a7-2af0-40f7-9240-4732733f559d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:54.993869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 27/51] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:48:54 2022] GET /identity/v3/users/46687a8108714da08b34f26401622753 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:54.999513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:55.019256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596736e-6bff-4295-8bdc-7073e7bb43ff None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:55.019538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596736e-6bff-4295-8bdc-7073e7bb43ff None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:55.019816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596736e-6bff-4295-8bdc-7073e7bb43ff None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:55.022221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 28/52] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:55.027261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeba93-f088-4722-abe6-2da48eb4ae46 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:55.027537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeba93-f088-4722-abe6-2da48eb4ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:55.027815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeba93-f088-4722-abe6-2da48eb4ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:55.051993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7abeba93-f088-4722-abe6-2da48eb4ae46 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:55.053290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:55.053452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7abeba93-f088-4722-abe6-2da48eb4ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:55.118579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cc45a-1398-4bdd-b691-5ad0026434b4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:55.122674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 29/53] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:48:55.152290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639030d-1eac-4000-9fb0-4248cf6de105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:55.152960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639030d-1eac-4000-9fb0-4248cf6de105 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:55.153250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639030d-1eac-4000-9fb0-4248cf6de105 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:55.153531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639030d-1eac-4000-9fb0-4248cf6de105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:55.154652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639030d-1eac-4000-9fb0-4248cf6de105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:55.156099 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639030d-1eac-4000-9fb0-4248cf6de105 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:55.157698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 25/54] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:48:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:55.163982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abeba93-f088-4722-abe6-2da48eb4ae46 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:55.193711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:55.264012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abeba93-f088-4722-abe6-2da48eb4ae46 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:55.298779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:55.299309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:55.299592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:55.299865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:55.300619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.domain.id=default, user.id=46687a8108714da08b34f26401622753) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:48:55.300929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:55.302362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:55.308226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 30/55] 10.222.0.75 () {56 vars in 1322 bytes} [Mon Sep 19 14:48:55 2022] GET /identity/v3/role_assignments?user.id=46687a8108714da08b34f26401622753&scope.domain.id=default&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:48:55.398808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639030d-1eac-4000-9fb0-4248cf6de105 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:55.610932 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639030d-1eac-4000-9fb0-4248cf6de105 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:55.621902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:55.644762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc415c-861d-4122-ac2f-a857fff8fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:55.645389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc415c-861d-4122-ac2f-a857fff8fe22 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:55.645669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc415c-861d-4122-ac2f-a857fff8fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:55.645942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc415c-861d-4122-ac2f-a857fff8fe22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:55.647051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc415c-861d-4122-ac2f-a857fff8fe22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:55.649067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc415c-861d-4122-ac2f-a857fff8fe22 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:55.650639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 26/56] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:55.656552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:55.754812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:55.761329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6a100-82b2-4f99-b9c1-3bb1d84ef66c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:55.794646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33059a64-1518-452d-b96b-e9dcf89a4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:55.795257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059a64-1518-452d-b96b-e9dcf89a4a28 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:55.795542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059a64-1518-452d-b96b-e9dcf89a4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:55.795818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059a64-1518-452d-b96b-e9dcf89a4a28 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:55.796461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33059a64-1518-452d-b96b-e9dcf89a4a28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:55.797931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33059a64-1518-452d-b96b-e9dcf89a4a28 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:55.912530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 31/57] 10.222.0.75 () {60 vars in 1140 bytes} [Mon Sep 19 14:48:55 2022] POST /identity/v3/projects => generated 298 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:48:58.073052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf43d-fb1a-438a-8f02-a14f76adfd0f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:58.073548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf43d-fb1a-438a-8f02-a14f76adfd0f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:58.073651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf43d-fb1a-438a-8f02-a14f76adfd0f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:58.074925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 27/58] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:58.080072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660d7d-f921-4347-b973-fdc6acf193f1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:58.080536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660d7d-f921-4347-b973-fdc6acf193f1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:58.080662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660d7d-f921-4347-b973-fdc6acf193f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:58.099359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-37660d7d-f921-4347-b973-fdc6acf193f1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:58.100606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-37660d7d-f921-4347-b973-fdc6acf193f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:58.167814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 32/59] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:48:58.436916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdf43d-fb1a-438a-8f02-a14f76adfd0f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:58.539429 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdf43d-fb1a-438a-8f02-a14f76adfd0f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:58.573746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdc458-e310-4349-a982-3da9c0bd7db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:58.574381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdc458-e310-4349-a982-3da9c0bd7db6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:58.574666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdc458-e310-4349-a982-3da9c0bd7db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:58.574943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdc458-e310-4349-a982-3da9c0bd7db6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:58.576129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdc458-e310-4349-a982-3da9c0bd7db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:58.577612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdc458-e310-4349-a982-3da9c0bd7db6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:58.579176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 28/60] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:48:58.584860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37660d7d-f921-4347-b973-fdc6acf193f1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:58.662561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:58.686083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37660d7d-f921-4347-b973-fdc6acf193f1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:58.721848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be4c30-20e4-461a-a175-c3788dd6a0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:58.722388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4c30-20e4-461a-a175-c3788dd6a0d8 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:58.722676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4c30-20e4-461a-a175-c3788dd6a0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:58.722957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4c30-20e4-461a-a175-c3788dd6a0d8 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:58.723623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be4c30-20e4-461a-a175-c3788dd6a0d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:58.725115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be4c30-20e4-461a-a175-c3788dd6a0d8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:58.892420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 33/61] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:48:58 2022] POST /identity/v3/users => generated 275 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:02.475155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b7b74-b62b-48c2-8681-ee72e165ed26 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.476246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b7b74-b62b-48c2-8681-ee72e165ed26 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.476719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b7b74-b62b-48c2-8681-ee72e165ed26 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.478392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 29/62] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:02.484371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d93e-e38e-4da5-9588-d6d80a670aba None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.485255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d93e-e38e-4da5-9588-d6d80a670aba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.485693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d93e-e38e-4da5-9588-d6d80a670aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.510027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b255d93e-e38e-4da5-9588-d6d80a670aba None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:02.511525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b255d93e-e38e-4da5-9588-d6d80a670aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:02.537870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ab04-282f-4aff-9eb4-0b36a691d089 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.538425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ab04-282f-4aff-9eb4-0b36a691d089 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.538867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ab04-282f-4aff-9eb4-0b36a691d089 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.540543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 30/63] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:02.546363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb1f9-5def-4bd1-8cb8-1f5885d8973d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.546956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb1f9-5def-4bd1-8cb8-1f5885d8973d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.547437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb1f9-5def-4bd1-8cb8-1f5885d8973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.571726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-035eb1f9-5def-4bd1-8cb8-1f5885d8973d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:02.576019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-035eb1f9-5def-4bd1-8cb8-1f5885d8973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:02.626171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 34/64] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:02.627926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edba6c-c4b5-4bea-a8a4-da75cfb2d081 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.628541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edba6c-c4b5-4bea-a8a4-da75cfb2d081 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.629048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edba6c-c4b5-4bea-a8a4-da75cfb2d081 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.630572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 35/65] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:02.637071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c0afc-8b27-4184-9514-2f2197861319 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.637573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c0afc-8b27-4184-9514-2f2197861319 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.637994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c0afc-8b27-4184-9514-2f2197861319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.668860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:02.669404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-af0c0afc-8b27-4184-9514-2f2197861319 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:02.670874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-af0c0afc-8b27-4184-9514-2f2197861319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:02.723312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 31/66] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:02.785320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:02.799098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 36/67] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:02.943515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9540-925c-4022-973f-8b4afbf57d3c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.943849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9540-925c-4022-973f-8b4afbf57d3c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.944150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9540-925c-4022-973f-8b4afbf57d3c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.946769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 32/68] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:02.952366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868e56-1c17-408a-8de0-6c3ed4f29cf6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.952771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868e56-1c17-408a-8de0-6c3ed4f29cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.953057 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868e56-1c17-408a-8de0-6c3ed4f29cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.970469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a8d2-e518-490b-b12c-dd23a46896ce None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.970784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a8d2-e518-490b-b12c-dd23a46896ce None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.971067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a8d2-e518-490b-b12c-dd23a46896ce None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.972668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 33/69] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:02.986457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb920ac-ffe9-46da-96e0-a81e73943659 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.986757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb920ac-ffe9-46da-96e0-a81e73943659 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.987018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb920ac-ffe9-46da-96e0-a81e73943659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.009273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-39868e56-1c17-408a-8de0-6c3ed4f29cf6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:03.010492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-39868e56-1c17-408a-8de0-6c3ed4f29cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:03.018058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9fb920ac-ffe9-46da-96e0-a81e73943659 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:03.019246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9fb920ac-ffe9-46da-96e0-a81e73943659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:03.103588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 34/70] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:03.104759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb920ac-ffe9-46da-96e0-a81e73943659 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.123713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 37/71] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:03.132986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868e56-1c17-408a-8de0-6c3ed4f29cf6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.311407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868e56-1c17-408a-8de0-6c3ed4f29cf6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.318634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb920ac-ffe9-46da-96e0-a81e73943659 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.337115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:03.341642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:03.350106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a725-ccfc-4b67-8568-afd2601490a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.351645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a725-ccfc-4b67-8568-afd2601490a5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.356210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a725-ccfc-4b67-8568-afd2601490a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.356210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a725-ccfc-4b67-8568-afd2601490a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.363658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951a725-ccfc-4b67-8568-afd2601490a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4951a725-ccfc-4b67-8568-afd2601490a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:03.369861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:03.370742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:03.371498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:03.374134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 38/72] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:03.375130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a725-ccfc-4b67-8568-afd2601490a5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.407789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f6b45-9d0b-45c1-ba26-73eb65337f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.408750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f6b45-9d0b-45c1-ba26-73eb65337f1f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.409030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f6b45-9d0b-45c1-ba26-73eb65337f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.409424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f6b45-9d0b-45c1-ba26-73eb65337f1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.425810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f6b45-9d0b-45c1-ba26-73eb65337f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f64f6b45-9d0b-45c1-ba26-73eb65337f1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:03.435232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:03.436169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 35/73] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:03.443460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f6b45-9d0b-45c1-ba26-73eb65337f1f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.510996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a725-ccfc-4b67-8568-afd2601490a5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.549961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cc63e-272a-42c7-a163-e159fd7ac34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.550607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cc63e-272a-42c7-a163-e159fd7ac34d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.550894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cc63e-272a-42c7-a163-e159fd7ac34d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.551174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cc63e-272a-42c7-a163-e159fd7ac34d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.562321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cc63e-272a-42c7-a163-e159fd7ac34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:03.564780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f6b45-9d0b-45c1-ba26-73eb65337f1f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ac5cc63e-272a-42c7-a163-e159fd7ac34d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:03.567249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:03.568138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:03.568950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 39/74] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:03.571217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cc63e-272a-42c7-a163-e159fd7ac34d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.603400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.604010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.604290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.604593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.605251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:03.605554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:03.607015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:03.615263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 36/75] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:03.621194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.621751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:03.651094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:03.686043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cc63e-272a-42c7-a163-e159fd7ac34d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.725849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07c13d-496d-49ae-8844-584adc7cf569 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.726053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215d35c-61fa-47f0-a8ae-ccc60c42f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.726939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d35c-61fa-47f0-a8ae-ccc60c42f23b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.727226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d35c-61fa-47f0-a8ae-ccc60c42f23b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.727505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d35c-61fa-47f0-a8ae-ccc60c42f23b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.738075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215d35c-61fa-47f0-a8ae-ccc60c42f23b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4215d35c-61fa-47f0-a8ae-ccc60c42f23b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:03.743973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:03.744907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:03.745665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 40/76] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:03.746295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215d35c-61fa-47f0-a8ae-ccc60c42f23b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.767095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5363701-6148-48db-ba02-25c71d1d3b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.767725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363701-6148-48db-ba02-25c71d1d3b53 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.768008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363701-6148-48db-ba02-25c71d1d3b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.768290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363701-6148-48db-ba02-25c71d1d3b53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.769438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5363701-6148-48db-ba02-25c71d1d3b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:03.770886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5363701-6148-48db-ba02-25c71d1d3b53 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:03.772452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 37/77] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:03.775265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5363701-6148-48db-ba02-25c71d1d3b53 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.876899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215d35c-61fa-47f0-a8ae-ccc60c42f23b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.878742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:03.893407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:03.900356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5363701-6148-48db-ba02-25c71d1d3b53 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:03.914106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.914834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.915126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.915407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.916085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:03.916613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:03.917903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:03.926512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 41/78] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:03.927324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:03.940326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:03.941280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.941561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.941939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.942607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:03.942914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:03.944272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:03.953177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 38/79] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:03.954009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.044868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ab21d-f711-47eb-a58d-4a6b88a68978 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.058968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fb058-71ea-4c66-b423-65f8a3cc28e9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.080422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07786a03-e315-4690-afd6-e53468a710f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.081094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786a03-e315-4690-afd6-e53468a710f9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.081379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786a03-e315-4690-afd6-e53468a710f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.081649 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07786a03-e315-4690-afd6-e53468a710f9 None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.093202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.093818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.094351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.094351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.095036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:04.095339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.096494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07786a03-e315-4690-afd6-e53468a710f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.096765 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.097957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07786a03-e315-4690-afd6-e53468a710f9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.099906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 42/80] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:04.100503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07786a03-e315-4690-afd6-e53468a710f9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.106081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 39/81] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:04.106930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.129292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:04.131117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:04.206835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07786a03-e315-4690-afd6-e53468a710f9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.222088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc700f8-add2-4ba0-818a-c40b97558c78 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.242497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c0cb-70cb-4b98-b393-a3af0afd628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.243115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c0cb-70cb-4b98-b393-a3af0afd628c None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.243399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c0cb-70cb-4b98-b393-a3af0afd628c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.243676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c0cb-70cb-4b98-b393-a3af0afd628c None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.244335 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8c0cb-70cb-4b98-b393-a3af0afd628c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.245814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8c0cb-70cb-4b98-b393-a3af0afd628c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.255869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42147b-01d2-448a-9b5b-92883ecfc655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.256534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42147b-01d2-448a-9b5b-92883ecfc655 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.256827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42147b-01d2-448a-9b5b-92883ecfc655 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.257161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42147b-01d2-448a-9b5b-92883ecfc655 None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.258493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42147b-01d2-448a-9b5b-92883ecfc655 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.259944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42147b-01d2-448a-9b5b-92883ecfc655 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.261585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 40/82] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:04 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:04.262512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42147b-01d2-448a-9b5b-92883ecfc655 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.349938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:04.355132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 43/83] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:49:04 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:04.356058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c0cb-70cb-4b98-b393-a3af0afd628c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.367585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42147b-01d2-448a-9b5b-92883ecfc655 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.411123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63443-5e46-4fb8-a7b8-17652b90ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.411773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63443-5e46-4fb8-a7b8-17652b90ddfc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.412068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63443-5e46-4fb8-a7b8-17652b90ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.412344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63443-5e46-4fb8-a7b8-17652b90ddfc None admin] PATH_INFO: `/v3/users/46687a8108714da08b34f26401622753` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.414455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63443-5e46-4fb8-a7b8-17652b90ddfc None admin] RBAC: Authorizing `identity:get_user(user_id=46687a8108714da08b34f26401622753)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.416105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63443-5e46-4fb8-a7b8-17652b90ddfc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.422670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 41/84] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:04 2022] GET /identity/v3/users/46687a8108714da08b34f26401622753 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:04.422670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63443-5e46-4fb8-a7b8-17652b90ddfc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.545803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:04.574168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c0cb-70cb-4b98-b393-a3af0afd628c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.577223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63443-5e46-4fb8-a7b8-17652b90ddfc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.614615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080c2eb-8bf5-4d38-af0e-2d0ca7539c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.615247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080c2eb-8bf5-4d38-af0e-2d0ca7539c48 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.615535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080c2eb-8bf5-4d38-af0e-2d0ca7539c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.615814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080c2eb-8bf5-4d38-af0e-2d0ca7539c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.628719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496994c2-238b-48dc-bd84-c62d276145aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.630533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496994c2-238b-48dc-bd84-c62d276145aa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.630533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496994c2-238b-48dc-bd84-c62d276145aa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.630533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496994c2-238b-48dc-bd84-c62d276145aa None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.631116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496994c2-238b-48dc-bd84-c62d276145aa None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.633510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496994c2-238b-48dc-bd84-c62d276145aa None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.635287 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 42/85] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:04 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:04.636335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496994c2-238b-48dc-bd84-c62d276145aa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.672016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:04.709742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080c2eb-8bf5-4d38-af0e-2d0ca7539c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.711456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080c2eb-8bf5-4d38-af0e-2d0ca7539c48 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.774017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496994c2-238b-48dc-bd84-c62d276145aa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.812132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba096-ebd2-43bd-9579-fdeeb800e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.812806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba096-ebd2-43bd-9579-fdeeb800e35b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.813093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba096-ebd2-43bd-9579-fdeeb800e35b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.813371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba096-ebd2-43bd-9579-fdeeb800e35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.832344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:04.867814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 44/86] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:04.873791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080c2eb-8bf5-4d38-af0e-2d0ca7539c48 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.918828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cba096-ebd2-43bd-9579-fdeeb800e35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.919742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cba096-ebd2-43bd-9579-fdeeb800e35b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.950384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.012306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080c2eb-8bf5-4d38-af0e-2d0ca7539c48 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:05.040394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 43/87] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:05.045458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba096-ebd2-43bd-9579-fdeeb800e35b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.062508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60275e-c2c7-4260-81d7-c851814c6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:05.064096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60275e-c2c7-4260-81d7-c851814c6a30 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.064657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60275e-c2c7-4260-81d7-c851814c6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.065136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60275e-c2c7-4260-81d7-c851814c6a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.130065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.161447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60275e-c2c7-4260-81d7-c851814c6a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:05.165152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60275e-c2c7-4260-81d7-c851814c6a30 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:05.165987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba096-ebd2-43bd-9579-fdeeb800e35b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:05.196907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.215352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2974d05-42fd-4a3f-ad40-5839667c7838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:05.216039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2974d05-42fd-4a3f-ad40-5839667c7838 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.216320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2974d05-42fd-4a3f-ad40-5839667c7838 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.216629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2974d05-42fd-4a3f-ad40-5839667c7838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.296002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 45/88] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:05.297344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60275e-c2c7-4260-81d7-c851814c6a30 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.305288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2974d05-42fd-4a3f-ad40-5839667c7838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:05.306888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2974d05-42fd-4a3f-ad40-5839667c7838 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:05.386182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.416266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60275e-c2c7-4260-81d7-c851814c6a30 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:05.437847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 44/89] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:05.439165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2974d05-42fd-4a3f-ad40-5839667c7838 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.466082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892347f8-42b2-46b2-8272-3d344b6d8ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:05.466650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892347f8-42b2-46b2-8272-3d344b6d8ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.466928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892347f8-42b2-46b2-8272-3d344b6d8ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.467203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892347f8-42b2-46b2-8272-3d344b6d8ec1 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.468918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892347f8-42b2-46b2-8272-3d344b6d8ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:05.470665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892347f8-42b2-46b2-8272-3d344b6d8ec1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:05.472603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.474388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 46/90] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:05.481200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892347f8-42b2-46b2-8272-3d344b6d8ec1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.582683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2974d05-42fd-4a3f-ad40-5839667c7838 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:05.618589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892347f8-42b2-46b2-8272-3d344b6d8ec1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:05.629583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc20a52-d7bd-4dc3-96e0-408753583ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:05.630227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc20a52-d7bd-4dc3-96e0-408753583ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.630507 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc20a52-d7bd-4dc3-96e0-408753583ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.630783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc20a52-d7bd-4dc3-96e0-408753583ef3 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.632524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc20a52-d7bd-4dc3-96e0-408753583ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:05.634229 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc20a52-d7bd-4dc3-96e0-408753583ef3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:05.636690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 45/91] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:05.637753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc20a52-d7bd-4dc3-96e0-408753583ef3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.658766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96621e-9990-4591-9a0d-3e6fd099e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:05.659780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96621e-9990-4591-9a0d-3e6fd099e7bc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.660307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96621e-9990-4591-9a0d-3e6fd099e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.660859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96621e-9990-4591-9a0d-3e6fd099e7bc None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.662192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96621e-9990-4591-9a0d-3e6fd099e7bc None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:05.664585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96621e-9990-4591-9a0d-3e6fd099e7bc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:05.666859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 47/92] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:05.667898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96621e-9990-4591-9a0d-3e6fd099e7bc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.685596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.772130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.787328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc20a52-d7bd-4dc3-96e0-408753583ef3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:05.798397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96621e-9990-4591-9a0d-3e6fd099e7bc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:05.830607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7a48-05fd-4fd9-9c92-2323ee14e713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:05.832394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7a48-05fd-4fd9-9c92-2323ee14e713 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.833238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7a48-05fd-4fd9-9c92-2323ee14e713 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.833700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7a48-05fd-4fd9-9c92-2323ee14e713 None admin] PATH_INFO: `/v3/projects/a2913505014a44f3ba8e5eacf6677d7d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.835491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e7a48-05fd-4fd9-9c92-2323ee14e713 None admin] RBAC: Authorizing `identity:get_project(project_id=a2913505014a44f3ba8e5eacf6677d7d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:05.837772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e7a48-05fd-4fd9-9c92-2323ee14e713 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:05.840712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 46/93] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/projects/a2913505014a44f3ba8e5eacf6677d7d => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:05.841715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7a48-05fd-4fd9-9c92-2323ee14e713 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.843382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:05.843994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.844276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.844576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.845972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] RBAC: Adding query filter params (role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4, user.id=f2ea2cda24db4580a183f631c5970850) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:05.847228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:05.848990 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:05.856745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 48/94] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/role_assignments?user.id=f2ea2cda24db4580a183f631c5970850&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=943b210730ce4efdaa3903233fba5962 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:05.857762 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.966801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.977278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7a48-05fd-4fd9-9c92-2323ee14e713 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:06.013086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe50464-e30b-4eb9-b681-7ffd81198522 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:06.031335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:06.031919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:06.032228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:06.032595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:06.033353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] RBAC: Adding query filter params (role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4, user.id=f2ea2cda24db4580a183f631c5970850) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:06.033711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:06.035178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:06.052737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 47/95] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/role_assignments?user.id=f2ea2cda24db4580a183f631c5970850&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:06.053449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:06.094022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:06.102296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10420b-529d-41d7-aa79-d6414a31b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:06.119218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10420b-529d-41d7-aa79-d6414a31b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:06.119218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10420b-529d-41d7-aa79-d6414a31b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:06.119218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10420b-529d-41d7-aa79-d6414a31b5d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:06.119218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10420b-529d-41d7-aa79-d6414a31b5d3 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4, user.id=46687a8108714da08b34f26401622753) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:06.119218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10420b-529d-41d7-aa79-d6414a31b5d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:06.119218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10420b-529d-41d7-aa79-d6414a31b5d3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:06.122679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 49/96] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/role_assignments?user.id=46687a8108714da08b34f26401622753&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:06.185386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f17799-8a45-440b-bcab-d5e294758966 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:06.232230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247ff89-972a-4a6f-8bcf-f12d29125ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:06.233174 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247ff89-972a-4a6f-8bcf-f12d29125ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:06.233621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247ff89-972a-4a6f-8bcf-f12d29125ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:06.234052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247ff89-972a-4a6f-8bcf-f12d29125ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:06.234960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247ff89-972a-4a6f-8bcf-f12d29125ce8 None admin] RBAC: Adding query filter params (role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=a2913505014a44f3ba8e5eacf6677d7d, user.id=f2ea2cda24db4580a183f631c5970850) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:06.235424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247ff89-972a-4a6f-8bcf-f12d29125ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:06.237073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247ff89-972a-4a6f-8bcf-f12d29125ce8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:06.245094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 48/97] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:06 2022] GET /identity/v3/role_assignments?user.id=f2ea2cda24db4580a183f631c5970850&scope.project.id=a2913505014a44f3ba8e5eacf6677d7d&role.id=943b210730ce4efdaa3903233fba5962 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:07.256215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e5575-1ae7-4eb6-95c8-70ef89cdb9bc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:07.256758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e5575-1ae7-4eb6-95c8-70ef89cdb9bc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:07.256920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e5575-1ae7-4eb6-95c8-70ef89cdb9bc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:07.259018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 50/98] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:07.264578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6853-d712-4bcc-99b1-f72393d5a9ae None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:07.265423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6853-d712-4bcc-99b1-f72393d5a9ae None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:07.265895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6853-d712-4bcc-99b1-f72393d5a9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:07.301559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-95bf6853-d712-4bcc-99b1-f72393d5a9ae None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:07.303308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-95bf6853-d712-4bcc-99b1-f72393d5a9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:07.330608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac870e23-b73c-4858-ab31-07476d90fbe4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:07.330908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac870e23-b73c-4858-ab31-07476d90fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:07.331173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac870e23-b73c-4858-ab31-07476d90fbe4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:07.332522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 51/99] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:07.342147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088812b-7300-434c-a02f-0fca8c63af49 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:07.342427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088812b-7300-434c-a02f-0fca8c63af49 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:07.342707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088812b-7300-434c-a02f-0fca8c63af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:07.384880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d088812b-7300-434c-a02f-0fca8c63af49 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:07.386868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d088812b-7300-434c-a02f-0fca8c63af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:07.447427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 49/100] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:07.509503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 52/101] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:07.866760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf6853-d712-4bcc-99b1-f72393d5a9ae None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:07.889797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:07.991298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf6853-d712-4bcc-99b1-f72393d5a9ae None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:08.036347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a1c4-4dd2-4c77-a949-6f57e35b34d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:08.037114 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a1c4-4dd2-4c77-a949-6f57e35b34d1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.037393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a1c4-4dd2-4c77-a949-6f57e35b34d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.037667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a1c4-4dd2-4c77-a949-6f57e35b34d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.039375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a1c4-4dd2-4c77-a949-6f57e35b34d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:08.041034 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a1c4-4dd2-4c77-a949-6f57e35b34d1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:08.042798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 50/102] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:08.048191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088812b-7300-434c-a02f-0fca8c63af49 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:08.061337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a1c4-4dd2-4c77-a949-6f57e35b34d1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:08.178406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:08.208906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088812b-7300-434c-a02f-0fca8c63af49 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:08.252956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:08.270377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a3fa4-1365-4f8a-a5a8-9321d917793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:08.271116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a3fa4-1365-4f8a-a5a8-9321d917793a None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.271381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a3fa4-1365-4f8a-a5a8-9321d917793a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.271592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a3fa4-1365-4f8a-a5a8-9321d917793a None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.272269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a3fa4-1365-4f8a-a5a8-9321d917793a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:08.276300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a3fa4-1365-4f8a-a5a8-9321d917793a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:08.289943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a1c4-4dd2-4c77-a949-6f57e35b34d1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:08.338847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c50ea-d994-4911-abe5-2644c1bfba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:08.339563 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c50ea-d994-4911-abe5-2644c1bfba78 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.339847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c50ea-d994-4911-abe5-2644c1bfba78 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.340125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c50ea-d994-4911-abe5-2644c1bfba78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.357428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c50ea-d994-4911-abe5-2644c1bfba78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-404c50ea-d994-4911-abe5-2644c1bfba78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:08.362589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:08.363439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:08.364220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 51/103] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:08.371109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c50ea-d994-4911-abe5-2644c1bfba78 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:08.427630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 53/104] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:49:08 2022] POST /identity/v3/projects => generated 302 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:08.535258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c50ea-d994-4911-abe5-2644c1bfba78 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:08.579331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:08.579970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.580257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.580559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.580657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704dbc-cb6a-455a-ac69-820a93acb32f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.580869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704dbc-cb6a-455a-ac69-820a93acb32f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.581152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704dbc-cb6a-455a-ac69-820a93acb32f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.581256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:08.581591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:08.582796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 54/105] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:08.584150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:08.588822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c3c6-8d94-4099-857d-f42c84649788 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.589185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c3c6-8d94-4099-857d-f42c84649788 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.589417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c3c6-8d94-4099-857d-f42c84649788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.605840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 52/106] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:08.611913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:08.617140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-20f3c3c6-8d94-4099-857d-f42c84649788 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:08.623341 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-20f3c3c6-8d94-4099-857d-f42c84649788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:08.628378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:08.727927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 55/107] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:08.813985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90450af-51ea-48fd-8664-3952d70b0080 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:08.868987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff978ff-5619-4e7a-9915-361e4f0900e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:08.869563 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff978ff-5619-4e7a-9915-361e4f0900e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.869902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff978ff-5619-4e7a-9915-361e4f0900e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.870189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff978ff-5619-4e7a-9915-361e4f0900e8 None admin] PATH_INFO: `/v3/users/186218ef39cd44318c045b255cf44a20` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.897211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff978ff-5619-4e7a-9915-361e4f0900e8 None admin] RBAC: Authorizing `identity:get_user(user_id=186218ef39cd44318c045b255cf44a20)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:08.899530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff978ff-5619-4e7a-9915-361e4f0900e8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:08.901575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 53/108] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:08 2022] GET /identity/v3/users/186218ef39cd44318c045b255cf44a20 => generated 289 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:08.907625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3c3c6-8d94-4099-857d-f42c84649788 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:08.982969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.043771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3c3c6-8d94-4099-857d-f42c84649788 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:09.088404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c83e1a-3722-4116-a8c2-f1bb9f155f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:09.089300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83e1a-3722-4116-a8c2-f1bb9f155f45 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.089723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83e1a-3722-4116-a8c2-f1bb9f155f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.090134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83e1a-3722-4116-a8c2-f1bb9f155f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.139630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff978ff-5619-4e7a-9915-361e4f0900e8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:09.185352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c83e1a-3722-4116-a8c2-f1bb9f155f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:09.187065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c83e1a-3722-4116-a8c2-f1bb9f155f45 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:09.235089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.285650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.322748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff978ff-5619-4e7a-9915-361e4f0900e8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:09.369570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 56/109] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:09.375423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c83e1a-3722-4116-a8c2-f1bb9f155f45 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:09.430040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17099956-3369-4e4f-97c3-85e2184e8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:09.430688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17099956-3369-4e4f-97c3-85e2184e8c8b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.430977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17099956-3369-4e4f-97c3-85e2184e8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.431256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17099956-3369-4e4f-97c3-85e2184e8c8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.460565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17099956-3369-4e4f-97c3-85e2184e8c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-17099956-3369-4e4f-97c3-85e2184e8c8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:09.466232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:09.467146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:09.467885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 54/110] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:49:09.473539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17099956-3369-4e4f-97c3-85e2184e8c8b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:09.596688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c83e1a-3722-4116-a8c2-f1bb9f155f45 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:09.634020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17099956-3369-4e4f-97c3-85e2184e8c8b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:09.638454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32923a8-f047-445a-8627-8fcd27998520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:09.639107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32923a8-f047-445a-8627-8fcd27998520 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.639393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32923a8-f047-445a-8627-8fcd27998520 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.639672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32923a8-f047-445a-8627-8fcd27998520 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.641378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32923a8-f047-445a-8627-8fcd27998520 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:09.642352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32923a8-f047-445a-8627-8fcd27998520 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:09.644311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 57/111] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:09 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:09.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317a40d-e1c1-4372-b7a7-21bf4a9dffcc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.645790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317a40d-e1c1-4372-b7a7-21bf4a9dffcc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.646272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317a40d-e1c1-4372-b7a7-21bf4a9dffcc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.648415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 58/112] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:09.650018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ed083-ffa1-4cb7-9d17-11f762d06b0b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.650528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ed083-ffa1-4cb7-9d17-11f762d06b0b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.651015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ed083-ffa1-4cb7-9d17-11f762d06b0b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.652999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 59/113] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:09.657886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448c1c-17ca-453b-9ad2-b7e9529e5e0f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.657886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448c1c-17ca-453b-9ad2-b7e9529e5e0f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.657886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448c1c-17ca-453b-9ad2-b7e9529e5e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.672915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.674659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-63448c1c-17ca-453b-9ad2-b7e9529e5e0f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:09.675891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-63448c1c-17ca-453b-9ad2-b7e9529e5e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:09.689768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:09.691225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.692008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.692555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.693461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:09.694056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:09.696634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:09.698927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.709543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 55/114] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:09.711305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:09.770554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 60/115] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:09.772917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae83ea-de1b-4733-b32e-1820efbaa8a1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.773480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae83ea-de1b-4733-b32e-1820efbaa8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.773980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae83ea-de1b-4733-b32e-1820efbaa8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.805691 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-45ae83ea-de1b-4733-b32e-1820efbaa8a1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:09.808015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-45ae83ea-de1b-4733-b32e-1820efbaa8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:09.876947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a6f0-5946-47c4-ae3b-b640cf4cc41f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:09.903431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 61/116] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:09.908713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae83ea-de1b-4733-b32e-1820efbaa8a1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:09.919357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd138d3-062c-463b-bc62-753f23c7ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:09.920036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd138d3-062c-463b-bc62-753f23c7ea79 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.920324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd138d3-062c-463b-bc62-753f23c7ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.920635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd138d3-062c-463b-bc62-753f23c7ea79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.921373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd138d3-062c-463b-bc62-753f23c7ea79 None admin] RBAC: Adding query filter params (role.id=ca153d9f3fae4e60b97c36c60d357c55, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4, user.id=186218ef39cd44318c045b255cf44a20) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:09.921685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd138d3-062c-463b-bc62-753f23c7ea79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:09.923118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd138d3-062c-463b-bc62-753f23c7ea79 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:09.930288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 56/117] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:09 2022] GET /identity/v3/role_assignments?user.id=186218ef39cd44318c045b255cf44a20&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=ca153d9f3fae4e60b97c36c60d357c55 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:09.932317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456dde3-c9f4-4fbd-a309-91290f52e8f7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.932638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456dde3-c9f4-4fbd-a309-91290f52e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.934960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456dde3-c9f4-4fbd-a309-91290f52e8f7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.935095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 57/118] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:09.941495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eaf82-f02d-4746-a1a1-fa9169d0eefc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.941782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eaf82-f02d-4746-a1a1-fa9169d0eefc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.942027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eaf82-f02d-4746-a1a1-fa9169d0eefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.966147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-765eaf82-f02d-4746-a1a1-fa9169d0eefc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:09.967550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-765eaf82-f02d-4746-a1a1-fa9169d0eefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:10.027157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:10.052418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 58/119] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:10.074002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eaf82-f02d-4746-a1a1-fa9169d0eefc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:10.092522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:10.120896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae83ea-de1b-4733-b32e-1820efbaa8a1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:10.183157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cd5ce-2338-4129-bf4b-7ad7ae50f0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:10.184200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd5ce-2338-4129-bf4b-7ad7ae50f0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:10.184718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd5ce-2338-4129-bf4b-7ad7ae50f0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:10.185201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd5ce-2338-4129-bf4b-7ad7ae50f0c5 None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:10.187707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cd5ce-2338-4129-bf4b-7ad7ae50f0c5 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:10.189557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cd5ce-2338-4129-bf4b-7ad7ae50f0c5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:10.191483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 62/120] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:09 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:10.197859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cd5ce-2338-4129-bf4b-7ad7ae50f0c5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:10.284104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eaf82-f02d-4746-a1a1-fa9169d0eefc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:10.322131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d507456-54a3-43e9-8fc2-3cd5f5b10d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:10.322828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d507456-54a3-43e9-8fc2-3cd5f5b10d56 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:10.323377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d507456-54a3-43e9-8fc2-3cd5f5b10d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:10.323453 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d507456-54a3-43e9-8fc2-3cd5f5b10d56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:10.336064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d507456-54a3-43e9-8fc2-3cd5f5b10d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:10.340165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cd5ce-2338-4129-bf4b-7ad7ae50f0c5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-5d507456-54a3-43e9-8fc2-3cd5f5b10d56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:10.341689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:10.342523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:10.343271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 59/121] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:49:10.352503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d507456-54a3-43e9-8fc2-3cd5f5b10d56 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:10.388742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4e525-5260-412e-b9e0-851735e4a9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:10.389720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e525-5260-412e-b9e0-851735e4a9db None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:10.390230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e525-5260-412e-b9e0-851735e4a9db None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:10.390706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e525-5260-412e-b9e0-851735e4a9db None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:10.392074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4e525-5260-412e-b9e0-851735e4a9db None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:10.393795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4e525-5260-412e-b9e0-851735e4a9db None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:10.395670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 63/122] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:10 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:10.396678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4e525-5260-412e-b9e0-851735e4a9db None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:10.396902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:10.416280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:10.459258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d507456-54a3-43e9-8fc2-3cd5f5b10d56 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:10.498685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:10.499368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:10.499653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:10.499927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:10.500625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:10.500931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:10.502298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:10.516222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 60/123] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:10.517331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:10.519203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4e525-5260-412e-b9e0-851735e4a9db None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:10.566658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d093841-9ab1-4a34-87e7-80a21c3af918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:10.568071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093841-9ab1-4a34-87e7-80a21c3af918 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:10.568635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093841-9ab1-4a34-87e7-80a21c3af918 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:10.569427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093841-9ab1-4a34-87e7-80a21c3af918 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:10.583908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d093841-9ab1-4a34-87e7-80a21c3af918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-8d093841-9ab1-4a34-87e7-80a21c3af918 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:10.591242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:10.592093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:10.592860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:10.595700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 64/124] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:10.597010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d093841-9ab1-4a34-87e7-80a21c3af918 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:10.633807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07bd19-3271-46eb-af19-8ee9c9831d5f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:10.637056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:10.683167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef5dce-4bfa-4acc-8f51-d43a772dd385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:10.684553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef5dce-4bfa-4acc-8f51-d43a772dd385 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:10.685059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef5dce-4bfa-4acc-8f51-d43a772dd385 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:10.685579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef5dce-4bfa-4acc-8f51-d43a772dd385 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/users/f2ea2cda24db4580a183f631c5970850/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:10.688305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef5dce-4bfa-4acc-8f51-d43a772dd385 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4a109b72e24a4fa4e3a27969f781d4, user_id=f2ea2cda24db4580a183f631c5970850, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:10.690966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef5dce-4bfa-4acc-8f51-d43a772dd385 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:10.693913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:10.716345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d093841-9ab1-4a34-87e7-80a21c3af918 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:10.759907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c978202-4765-43e1-8cc8-721006e17d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:10.760588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c978202-4765-43e1-8cc8-721006e17d04 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:10.760875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c978202-4765-43e1-8cc8-721006e17d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:10.761150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c978202-4765-43e1-8cc8-721006e17d04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:10.776025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 61/125] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:10 2022] PUT /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/users/f2ea2cda24db4580a183f631c5970850/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:10.781679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef5dce-4bfa-4acc-8f51-d43a772dd385 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:10.783145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c978202-4765-43e1-8cc8-721006e17d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0c978202-4765-43e1-8cc8-721006e17d04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:10.792451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:10.793625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:10.794427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:10.799461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 65/126] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:10.800569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c978202-4765-43e1-8cc8-721006e17d04 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:10.980131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c978202-4765-43e1-8cc8-721006e17d04 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.024309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.025016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.025764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.026064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.026982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:11.027299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.028832 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.035274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:11.041261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef5dce-4bfa-4acc-8f51-d43a772dd385 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.044507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 66/127] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:11.047844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.088988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ab49-a628-4f55-8bad-c7c0dd4991e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.089979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ab49-a628-4f55-8bad-c7c0dd4991e5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.090499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ab49-a628-4f55-8bad-c7c0dd4991e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.090980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ab49-a628-4f55-8bad-c7c0dd4991e5 None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.092338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ab49-a628-4f55-8bad-c7c0dd4991e5 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.094101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ab49-a628-4f55-8bad-c7c0dd4991e5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.096316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 62/128] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:10 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:11.097382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ab49-a628-4f55-8bad-c7c0dd4991e5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.133792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:11.184118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1692508-773d-4988-994a-6b2da380fc21 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.226160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.226949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.227244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.227646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.228334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:11.228686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.231345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.241941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ab49-a628-4f55-8bad-c7c0dd4991e5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.242358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 67/129] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:11.243476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.316543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:11.332092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b9aa1-f983-45d8-9325-08c03ba83159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.333342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b9aa1-f983-45d8-9325-08c03ba83159 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.333779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b9aa1-f983-45d8-9325-08c03ba83159 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.334193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b9aa1-f983-45d8-9325-08c03ba83159 None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.339398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b9aa1-f983-45d8-9325-08c03ba83159 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.341153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b9aa1-f983-45d8-9325-08c03ba83159 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.343150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 63/130] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:11 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:11.344088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b9aa1-f983-45d8-9325-08c03ba83159 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.362023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52268cc-8b3a-45d1-88b1-9f4740c4c8d9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.400794 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664725b0-5676-46b5-aff8-b57ee0cf4781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.401833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664725b0-5676-46b5-aff8-b57ee0cf4781 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.402126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664725b0-5676-46b5-aff8-b57ee0cf4781 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.402418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664725b0-5676-46b5-aff8-b57ee0cf4781 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.404141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664725b0-5676-46b5-aff8-b57ee0cf4781 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.405849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664725b0-5676-46b5-aff8-b57ee0cf4781 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.407597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 68/131] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:11 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:11.408672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664725b0-5676-46b5-aff8-b57ee0cf4781 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.534936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b9aa1-f983-45d8-9325-08c03ba83159 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.548870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:11.575437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c0900-f001-452d-852c-413d81309851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.576090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c0900-f001-452d-852c-413d81309851 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.576382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c0900-f001-452d-852c-413d81309851 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.576687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c0900-f001-452d-852c-413d81309851 None admin] PATH_INFO: `/v3/users/46687a8108714da08b34f26401622753` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.578024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c0900-f001-452d-852c-413d81309851 None admin] RBAC: Authorizing `identity:get_user(user_id=46687a8108714da08b34f26401622753)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.579663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c0900-f001-452d-852c-413d81309851 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.581294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 64/132] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:11 2022] GET /identity/v3/users/46687a8108714da08b34f26401622753 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:11.582683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c0900-f001-452d-852c-413d81309851 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.642445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664725b0-5676-46b5-aff8-b57ee0cf4781 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.700164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800f9d3-5466-486d-b218-84453fecef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.701363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800f9d3-5466-486d-b218-84453fecef55 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.701786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800f9d3-5466-486d-b218-84453fecef55 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.702070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800f9d3-5466-486d-b218-84453fecef55 None admin] PATH_INFO: `/v3/projects/a2913505014a44f3ba8e5eacf6677d7d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.703225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800f9d3-5466-486d-b218-84453fecef55 None admin] RBAC: Authorizing `identity:get_project(project_id=a2913505014a44f3ba8e5eacf6677d7d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.703734 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c0900-f001-452d-852c-413d81309851 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.704732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800f9d3-5466-486d-b218-84453fecef55 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.707581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 69/133] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:11 2022] GET /identity/v3/projects/a2913505014a44f3ba8e5eacf6677d7d => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:11.708391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800f9d3-5466-486d-b218-84453fecef55 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.712888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:11.758806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2ab1c-82d2-4d3b-84f6-6887213d8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.759666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2ab1c-82d2-4d3b-84f6-6887213d8e33 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.760074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2ab1c-82d2-4d3b-84f6-6887213d8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.760430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2ab1c-82d2-4d3b-84f6-6887213d8e33 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/users/f2ea2cda24db4580a183f631c5970850/roles/3b586edbe9c24d7288ee1a8e48781662` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.763079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2ab1c-82d2-4d3b-84f6-6887213d8e33 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4a109b72e24a4fa4e3a27969f781d4, user_id=f2ea2cda24db4580a183f631c5970850, role_id=3b586edbe9c24d7288ee1a8e48781662)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.765221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2ab1c-82d2-4d3b-84f6-6887213d8e33 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.834140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800f9d3-5466-486d-b218-84453fecef55 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:11.873808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce36cc-9cd5-445c-8c51-8fad1c2d5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:11.874469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce36cc-9cd5-445c-8c51-8fad1c2d5e1a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.874755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce36cc-9cd5-445c-8c51-8fad1c2d5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.875034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce36cc-9cd5-445c-8c51-8fad1c2d5e1a None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.876199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce36cc-9cd5-445c-8c51-8fad1c2d5e1a None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:11.877731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce36cc-9cd5-445c-8c51-8fad1c2d5e1a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:11.879587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 70/134] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:11 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:11.880537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7081-2058-4e79-be90-4733ffa49fa2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:11.880825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7081-2058-4e79-be90-4733ffa49fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:11.881102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb7081-2058-4e79-be90-4733ffa49fa2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:11.882728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 71/135] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:11.883179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb7081-2058-4e79-be90-4733ffa49fa2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.924960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 65/136] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:11 2022] PUT /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/users/f2ea2cda24db4580a183f631c5970850/roles/3b586edbe9c24d7288ee1a8e48781662 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:11.925775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2ab1c-82d2-4d3b-84f6-6887213d8e33 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:11.979631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:12.001989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:12.030025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb7081-2058-4e79-be90-4733ffa49fa2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:12.078805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb4ff-e330-4846-9c9f-4eb2ed89aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:12.080058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb4ff-e330-4846-9c9f-4eb2ed89aaf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.080568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb4ff-e330-4846-9c9f-4eb2ed89aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.081084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb4ff-e330-4846-9c9f-4eb2ed89aaf5 None admin] PATH_INFO: `/v3/projects/a2913505014a44f3ba8e5eacf6677d7d/users/f2ea2cda24db4580a183f631c5970850/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.083385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb4ff-e330-4846-9c9f-4eb2ed89aaf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2913505014a44f3ba8e5eacf6677d7d, user_id=f2ea2cda24db4580a183f631c5970850, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:12.085506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb4ff-e330-4846-9c9f-4eb2ed89aaf5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:12.151464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2ab1c-82d2-4d3b-84f6-6887213d8e33 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:12.188090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 72/137] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:11 2022] PUT /identity/v3/projects/a2913505014a44f3ba8e5eacf6677d7d/users/f2ea2cda24db4580a183f631c5970850/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:12.188090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76634-355f-4346-a2fc-5751fc336dfc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.188090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76634-355f-4346-a2fc-5751fc336dfc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.188402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76634-355f-4346-a2fc-5751fc336dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.198968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c23d0-3a2b-4261-ab8a-75ff3b084c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:12.199660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c23d0-3a2b-4261-ab8a-75ff3b084c0b None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.199994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c23d0-3a2b-4261-ab8a-75ff3b084c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.200274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c23d0-3a2b-4261-ab8a-75ff3b084c0b None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/users/46687a8108714da08b34f26401622753/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.203065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c23d0-3a2b-4261-ab8a-75ff3b084c0b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4a109b72e24a4fa4e3a27969f781d4, user_id=46687a8108714da08b34f26401622753, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:12.206774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c23d0-3a2b-4261-ab8a-75ff3b084c0b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:12.229459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-75e76634-355f-4346-a2fc-5751fc336dfc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:12.230786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-75e76634-355f-4346-a2fc-5751fc336dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:12.295831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 66/138] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:11 2022] PUT /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/users/46687a8108714da08b34f26401622753/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:12.341817 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 73/139] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:12.692733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fae98-c69c-4fbe-ac5f-712943916812 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.693607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fae98-c69c-4fbe-ac5f-712943916812 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.694081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fae98-c69c-4fbe-ac5f-712943916812 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.695837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 67/140] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:12.702314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7519ef-449e-48b1-86fc-94b3d2c04c5a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.703159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7519ef-449e-48b1-86fc-94b3d2c04c5a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.703616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7519ef-449e-48b1-86fc-94b3d2c04c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.707519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fae98-c69c-4fbe-ac5f-712943916812 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:12.725226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2f7519ef-449e-48b1-86fc-94b3d2c04c5a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:12.727721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2f7519ef-449e-48b1-86fc-94b3d2c04c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:12.793938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:12.808386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 74/141] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:12.861096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:12.881413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fae98-c69c-4fbe-ac5f-712943916812 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:12.926509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7dc6a-8355-45f7-8dd3-1caa0d9e11f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:12.927157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7dc6a-8355-45f7-8dd3-1caa0d9e11f8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.927442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7dc6a-8355-45f7-8dd3-1caa0d9e11f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.927714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7dc6a-8355-45f7-8dd3-1caa0d9e11f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.929708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7dc6a-8355-45f7-8dd3-1caa0d9e11f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:12.931187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7dc6a-8355-45f7-8dd3-1caa0d9e11f8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:12.932830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 68/142] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:12.938308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7519ef-449e-48b1-86fc-94b3d2c04c5a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:13.095747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7519ef-449e-48b1-86fc-94b3d2c04c5a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:13.148770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c094-fb87-4a6b-a1e7-a5608c4aed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:13.149398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c094-fb87-4a6b-a1e7-a5608c4aed08 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:13.149683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c094-fb87-4a6b-a1e7-a5608c4aed08 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:13.149961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c094-fb87-4a6b-a1e7-a5608c4aed08 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:13.150628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24c094-fb87-4a6b-a1e7-a5608c4aed08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:13.152076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24c094-fb87-4a6b-a1e7-a5608c4aed08 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:13.255948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7dc6a-8355-45f7-8dd3-1caa0d9e11f8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:13.284126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 75/143] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:49:12 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:13.404454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7dc6a-8355-45f7-8dd3-1caa0d9e11f8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:13.444453 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e779-3d4d-4649-8878-8122905f4572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:13.445154 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e779-3d4d-4649-8878-8122905f4572 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:13.445435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e779-3d4d-4649-8878-8122905f4572 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:13.445711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e779-3d4d-4649-8878-8122905f4572 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:13.463567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e779-3d4d-4649-8878-8122905f4572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-49f3e779-3d4d-4649-8878-8122905f4572 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:13.468802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:13.469686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:13.470454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 69/144] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:13.478329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c094-fb87-4a6b-a1e7-a5608c4aed08 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:13.557504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:13.643470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c094-fb87-4a6b-a1e7-a5608c4aed08 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:13.681093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:13.681736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:13.682021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:13.682303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:13.682991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:13.683298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:13.684756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:13.694002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 76/145] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:13.701257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e779-3d4d-4649-8878-8122905f4572 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:13.735869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:13.849191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e779-3d4d-4649-8878-8122905f4572 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:13.894831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa1fa8-bdb5-4efe-9f27-6a603dcf9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:13.895490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa1fa8-bdb5-4efe-9f27-6a603dcf9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:13.895774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa1fa8-bdb5-4efe-9f27-6a603dcf9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:13.896069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa1fa8-bdb5-4efe-9f27-6a603dcf9bb4 None admin] PATH_INFO: `/v3/users/186218ef39cd44318c045b255cf44a20` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:13.898085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa1fa8-bdb5-4efe-9f27-6a603dcf9bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=186218ef39cd44318c045b255cf44a20)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:13.899564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa1fa8-bdb5-4efe-9f27-6a603dcf9bb4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:13.901517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 70/146] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:13 2022] GET /identity/v3/users/186218ef39cd44318c045b255cf44a20 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:13.906947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:13.997625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c5b32-30f2-4fc2-96c2-e5cda3a5cb57 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:13.997897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c5b32-30f2-4fc2-96c2-e5cda3a5cb57 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:13.998162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c5b32-30f2-4fc2-96c2-e5cda3a5cb57 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:13.999616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 71/147] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:14.005447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ef89c-eedb-4703-b3fb-63561fd751d0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:14.005733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ef89c-eedb-4703-b3fb-63561fd751d0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:14.006033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ef89c-eedb-4703-b3fb-63561fd751d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:14.044785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fd2ef89c-eedb-4703-b3fb-63561fd751d0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:14.046072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fd2ef89c-eedb-4703-b3fb-63561fd751d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:14.101503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396fa99-af94-43e5-b3bc-7c881bfdd1e7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:14.104793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:14.150219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10559-d444-4cf5-9e83-2119659a8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:14.150864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10559-d444-4cf5-9e83-2119659a8567 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:14.151142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10559-d444-4cf5-9e83-2119659a8567 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:14.151472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f10559-d444-4cf5-9e83-2119659a8567 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:14.153347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f10559-d444-4cf5-9e83-2119659a8567 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:14.154803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f10559-d444-4cf5-9e83-2119659a8567 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:14.158593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 77/148] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:13 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:14.165753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10559-d444-4cf5-9e83-2119659a8567 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:14.203977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 72/149] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:14.317876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f10559-d444-4cf5-9e83-2119659a8567 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:14.358737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e769-aa13-4f58-89c9-5f2ab580757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:14.359398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e769-aa13-4f58-89c9-5f2ab580757c None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:14.359686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e769-aa13-4f58-89c9-5f2ab580757c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:14.359955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e769-aa13-4f58-89c9-5f2ab580757c None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/users/186218ef39cd44318c045b255cf44a20/roles/ca153d9f3fae4e60b97c36c60d357c55` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:14.362701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210e769-aa13-4f58-89c9-5f2ab580757c None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4a109b72e24a4fa4e3a27969f781d4, user_id=186218ef39cd44318c045b255cf44a20, role_id=ca153d9f3fae4e60b97c36c60d357c55)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:14.364216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210e769-aa13-4f58-89c9-5f2ab580757c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:14.456863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 78/150] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:14 2022] PUT /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/users/186218ef39cd44318c045b255cf44a20/roles/ca153d9f3fae4e60b97c36c60d357c55 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:14.639505 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ef89c-eedb-4703-b3fb-63561fd751d0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:14.659681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:14.761555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ef89c-eedb-4703-b3fb-63561fd751d0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:14.798594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e84e44-5c2f-423d-b778-8d1be84b0cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:14.799249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e84e44-5c2f-423d-b778-8d1be84b0cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:14.799527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e84e44-5c2f-423d-b778-8d1be84b0cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:14.799797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e84e44-5c2f-423d-b778-8d1be84b0cf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:14.822978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e84e44-5c2f-423d-b778-8d1be84b0cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b6e84e44-5c2f-423d-b778-8d1be84b0cf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:14.827958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:14.828856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:14.830069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 73/151] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:14.835633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e769-aa13-4f58-89c9-5f2ab580757c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:14.876702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:14.965698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e769-aa13-4f58-89c9-5f2ab580757c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:15.012444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:15.013088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.013374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.013701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.014376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:15.014724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:15.016184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:15.028378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 79/152] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:15.034199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e84e44-5c2f-423d-b778-8d1be84b0cf7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:15.137791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:15.168878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e84e44-5c2f-423d-b778-8d1be84b0cf7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:15.213226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7383f3-551f-4e2b-8a04-5345b3d5c2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:15.213881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7383f3-551f-4e2b-8a04-5345b3d5c2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.214165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7383f3-551f-4e2b-8a04-5345b3d5c2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.214441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7383f3-551f-4e2b-8a04-5345b3d5c2d9 None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.215639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7383f3-551f-4e2b-8a04-5345b3d5c2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:15.229015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7383f3-551f-4e2b-8a04-5345b3d5c2d9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:15.229015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 74/153] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:15 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:15.229460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:15.273338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18f31-0c93-456c-9bfc-d0adace6a159 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.273529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18f31-0c93-456c-9bfc-d0adace6a159 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.273793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d18f31-0c93-456c-9bfc-d0adace6a159 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.275485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 75/154] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:15.280916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6266-72ad-42c4-bafd-5b762bb6b85f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.281191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6266-72ad-42c4-bafd-5b762bb6b85f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.281457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6266-72ad-42c4-bafd-5b762bb6b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.317592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8b8a6266-72ad-42c4-bafd-5b762bb6b85f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:15.318827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8b8a6266-72ad-42c4-bafd-5b762bb6b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:15.408708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:15.417635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25542f-d686-4626-a67c-41da53b1c0e6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:15.478186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29a86-6cbf-45a4-8702-6264786a13db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:15.478536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 76/155] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:15.478893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29a86-6cbf-45a4-8702-6264786a13db None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.479239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29a86-6cbf-45a4-8702-6264786a13db None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.479465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29a86-6cbf-45a4-8702-6264786a13db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.580263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb29a86-6cbf-45a4-8702-6264786a13db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:15.581796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb29a86-6cbf-45a4-8702-6264786a13db None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:15.660029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0833609-e007-496c-99fc-134bd2476be6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.660351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0833609-e007-496c-99fc-134bd2476be6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.660622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0833609-e007-496c-99fc-134bd2476be6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.661968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 77/156] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:15.674009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c35b2-b6b1-48c4-9b99-e20610917fdd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.674307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c35b2-b6b1-48c4-9b99-e20610917fdd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.674564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c35b2-b6b1-48c4-9b99-e20610917fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.712177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-294c35b2-b6b1-48c4-9b99-e20610917fdd None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:15.713422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-294c35b2-b6b1-48c4-9b99-e20610917fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:15.728856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:15.740334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 80/157] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:15.745977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29a86-6cbf-45a4-8702-6264786a13db None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:15.914252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 78/158] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:15.946801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29a86-6cbf-45a4-8702-6264786a13db None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:16.008509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881616-676a-4c27-887b-9de547f1fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:16.009102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881616-676a-4c27-887b-9de547f1fb8f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.009419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881616-676a-4c27-887b-9de547f1fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.009627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881616-676a-4c27-887b-9de547f1fb8f None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.010801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881616-676a-4c27-887b-9de547f1fb8f None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:16.012280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881616-676a-4c27-887b-9de547f1fb8f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:16.013968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 81/159] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:15 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:16.019784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c35b2-b6b1-48c4-9b99-e20610917fdd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:16.023236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:16.121555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881616-676a-4c27-887b-9de547f1fb8f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:16.205417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c35b2-b6b1-48c4-9b99-e20610917fdd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:16.273377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:16.311127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:16.311758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.312042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.312317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.313105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] RBAC: Adding query filter params (role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4, user.id=f2ea2cda24db4580a183f631c5970850) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:16.313415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:16.314913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:16.322701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 79/160] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:16 2022] GET /identity/v3/role_assignments?user.id=f2ea2cda24db4580a183f631c5970850&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=943b210730ce4efdaa3903233fba5962 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:16.355604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881616-676a-4c27-887b-9de547f1fb8f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:16.410917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bf6e5-a772-4e88-82b0-f279103d3369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:16.415042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf6e5-a772-4e88-82b0-f279103d3369 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.415042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf6e5-a772-4e88-82b0-f279103d3369 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.415042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf6e5-a772-4e88-82b0-f279103d3369 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.431900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bf6e5-a772-4e88-82b0-f279103d3369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a76bf6e5-a772-4e88-82b0-f279103d3369 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:16.437080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:16.437951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:16.438747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:16.439348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 82/161] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:16.444438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:16.520843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:16.561390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf9b7-dd04-41b4-a5c5-69d1877aba64 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:16.604239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614253f-42d0-4319-891b-cbe04c64e4ad None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.604580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614253f-42d0-4319-891b-cbe04c64e4ad None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.604824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614253f-42d0-4319-891b-cbe04c64e4ad None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.606205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 83/162] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:16.609876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:16.610524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.610809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.611089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.611795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:16.612103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:16.613692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:16.614935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942e14-5c7f-4b99-a19e-d226f7dce80a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.615223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942e14-5c7f-4b99-a19e-d226f7dce80a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.616677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942e14-5c7f-4b99-a19e-d226f7dce80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.627847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 80/163] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:16.629177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:16.665659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-32942e14-5c7f-4b99-a19e-d226f7dce80a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:16.666898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-32942e14-5c7f-4b99-a19e-d226f7dce80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:16.784887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486ad09-5afd-490e-9667-182bbb6c064a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:16.824882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:16.835454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bfb5e-4fd9-4f73-94f4-ab15c2eaeb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:16.836105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bfb5e-4fd9-4f73-94f4-ab15c2eaeb46 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.848945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bfb5e-4fd9-4f73-94f4-ab15c2eaeb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.848945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bfb5e-4fd9-4f73-94f4-ab15c2eaeb46 None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.848945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bfb5e-4fd9-4f73-94f4-ab15c2eaeb46 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:16.848945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bfb5e-4fd9-4f73-94f4-ab15c2eaeb46 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:16.848945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 81/164] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:16 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:16.848945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bfb5e-4fd9-4f73-94f4-ab15c2eaeb46 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:16.974138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 84/165] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:16.975100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942e14-5c7f-4b99-a19e-d226f7dce80a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:16.987231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bfb5e-4fd9-4f73-94f4-ab15c2eaeb46 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:17.039008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4432-90e9-4d5e-b929-ca12f7d6514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:17.039705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4432-90e9-4d5e-b929-ca12f7d6514b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:17.039990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4432-90e9-4d5e-b929-ca12f7d6514b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:17.040264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e4432-90e9-4d5e-b929-ca12f7d6514b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:17.059420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e4432-90e9-4d5e-b929-ca12f7d6514b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f83e4432-90e9-4d5e-b929-ca12f7d6514b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:17.065581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:17.066435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:17.067526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 82/166] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:17.074424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4432-90e9-4d5e-b929-ca12f7d6514b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:17.151460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:17.164809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:17.217174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942e14-5c7f-4b99-a19e-d226f7dce80a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:17.229704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e4432-90e9-4d5e-b929-ca12f7d6514b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:17.269741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d40b3-9867-414f-8f9b-3a3b0354b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:17.270367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d40b3-9867-414f-8f9b-3a3b0354b2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:17.270647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d40b3-9867-414f-8f9b-3a3b0354b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:17.270923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d40b3-9867-414f-8f9b-3a3b0354b2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:17.282159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:17.282795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:17.283079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:17.283470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:17.284148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:17.284456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:17.286127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:17.300392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 83/167] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:17.306501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:17.425407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d40b3-9867-414f-8f9b-3a3b0354b2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:17.426818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d40b3-9867-414f-8f9b-3a3b0354b2a8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:17.472856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6509-3e04-439f-9715-e8845c37c1d6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:17.496012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:17.522248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901bf88-52d8-49fc-b2b4-6a8e4c143a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:17.523572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901bf88-52d8-49fc-b2b4-6a8e4c143a34 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:17.523861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901bf88-52d8-49fc-b2b4-6a8e4c143a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:17.524141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901bf88-52d8-49fc-b2b4-6a8e4c143a34 None admin] PATH_INFO: `/v3/users/46687a8108714da08b34f26401622753` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:17.529496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901bf88-52d8-49fc-b2b4-6a8e4c143a34 None admin] RBAC: Authorizing `identity:get_user(user_id=46687a8108714da08b34f26401622753)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:17.531030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901bf88-52d8-49fc-b2b4-6a8e4c143a34 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:17.532796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 84/168] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:17 2022] GET /identity/v3/users/46687a8108714da08b34f26401622753 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:17.538817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901bf88-52d8-49fc-b2b4-6a8e4c143a34 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:17.539531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:17.646703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 85/169] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:17.653533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d40b3-9867-414f-8f9b-3a3b0354b2a8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:17.767364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901bf88-52d8-49fc-b2b4-6a8e4c143a34 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:17.859663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d40b3-9867-414f-8f9b-3a3b0354b2a8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:17.860683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f86b-e73d-4a24-bde4-320b3b6132be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:17.861544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f86b-e73d-4a24-bde4-320b3b6132be None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:17.862056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f86b-e73d-4a24-bde4-320b3b6132be None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:17.862530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f86b-e73d-4a24-bde4-320b3b6132be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:17.937756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f681-e567-4786-85e2-456b1b4ccbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:17.938421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f681-e567-4786-85e2-456b1b4ccbbd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:17.938705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f681-e567-4786-85e2-456b1b4ccbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:17.938983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f681-e567-4786-85e2-456b1b4ccbbd None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:17.941498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456f681-e567-4786-85e2-456b1b4ccbbd None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:17.942985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456f681-e567-4786-85e2-456b1b4ccbbd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:17.945712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 86/170] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:17 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:17.946202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f681-e567-4786-85e2-456b1b4ccbbd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:17.992534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:17.993803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:18.037609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4f86b-e73d-4a24-bde4-320b3b6132be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:18.039623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4f86b-e73d-4a24-bde4-320b3b6132be None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:18.160409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f681-e567-4786-85e2-456b1b4ccbbd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:18.245343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24291-1df8-4ece-8654-ff949600eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:18.246487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24291-1df8-4ece-8654-ff949600eeba None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.246960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24291-1df8-4ece-8654-ff949600eeba None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.247422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24291-1df8-4ece-8654-ff949600eeba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.262962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 85/171] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:18.263828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f86b-e73d-4a24-bde4-320b3b6132be None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:18.266966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24291-1df8-4ece-8654-ff949600eeba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-48c24291-1df8-4ece-8654-ff949600eeba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:18.272876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:18.273831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:18.274695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:18.277223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 87/172] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:18.278301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24291-1df8-4ece-8654-ff949600eeba None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:18.440158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:18.447278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:18.477639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f86b-e73d-4a24-bde4-320b3b6132be None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:18.496714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24291-1df8-4ece-8654-ff949600eeba None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:18.563807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f1c2a-705b-49ee-ba21-b47376495a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:18.564460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1c2a-705b-49ee-ba21-b47376495a30 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.564764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1c2a-705b-49ee-ba21-b47376495a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.565034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f1c2a-705b-49ee-ba21-b47376495a30 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.566839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f1c2a-705b-49ee-ba21-b47376495a30 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:18.569034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f1c2a-705b-49ee-ba21-b47376495a30 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:18.573091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 88/173] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:18 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:18.574291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f1c2a-705b-49ee-ba21-b47376495a30 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:18.576057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb187f89-83e8-4250-8e67-647377eca98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:18.576705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb187f89-83e8-4250-8e67-647377eca98a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.576985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb187f89-83e8-4250-8e67-647377eca98a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.577255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb187f89-83e8-4250-8e67-647377eca98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.578065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb187f89-83e8-4250-8e67-647377eca98a None admin] RBAC: Adding query filter params (role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4, user.id=f2ea2cda24db4580a183f631c5970850) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:18.578368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb187f89-83e8-4250-8e67-647377eca98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:18.579821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb187f89-83e8-4250-8e67-647377eca98a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:18.591991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 86/174] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:18 2022] GET /identity/v3/role_assignments?user.id=f2ea2cda24db4580a183f631c5970850&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:18.591991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dfda-7f24-4b15-913c-82a20ab94b8c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.591991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dfda-7f24-4b15-913c-82a20ab94b8c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.591991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dfda-7f24-4b15-913c-82a20ab94b8c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.591991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 87/175] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:18.595374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae423e-164b-492c-9dec-a6d4dd8ec142 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.595659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae423e-164b-492c-9dec-a6d4dd8ec142 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.595937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae423e-164b-492c-9dec-a6d4dd8ec142 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.597298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 88/176] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:18.598006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae423e-164b-492c-9dec-a6d4dd8ec142 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:18.720259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f1c2a-705b-49ee-ba21-b47376495a30 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:18.727832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae423e-164b-492c-9dec-a6d4dd8ec142 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:18.778434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff4435-7074-4389-9d20-760dc7f61bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:18.778710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff4435-7074-4389-9d20-760dc7f61bcc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.778972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff4435-7074-4389-9d20-760dc7f61bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.779239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff4435-7074-4389-9d20-760dc7f61bcc None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.779915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff4435-7074-4389-9d20-760dc7f61bcc None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:18.780216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff4435-7074-4389-9d20-760dc7f61bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:18.781689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff4435-7074-4389-9d20-760dc7f61bcc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:18.785902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482a31-86d4-4d4c-a3fc-63a37a11dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:18.786851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482a31-86d4-4d4c-a3fc-63a37a11dc89 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.787340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482a31-86d4-4d4c-a3fc-63a37a11dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.788869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482a31-86d4-4d4c-a3fc-63a37a11dc89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.789657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482a31-86d4-4d4c-a3fc-63a37a11dc89 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4, user.id=46687a8108714da08b34f26401622753) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:18.789972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482a31-86d4-4d4c-a3fc-63a37a11dc89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:18.791438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482a31-86d4-4d4c-a3fc-63a37a11dc89 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:18.797450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 89/177] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:18.799351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 89/178] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:18 2022] GET /identity/v3/role_assignments?user.id=46687a8108714da08b34f26401622753&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:18.800696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11106ba-169d-4f98-9353-2d94892d1fe7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.800979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11106ba-169d-4f98-9353-2d94892d1fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.801253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11106ba-169d-4f98-9353-2d94892d1fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.804519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef9a3-b301-4b76-aa97-62ab2f2d0b3a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.804990 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef9a3-b301-4b76-aa97-62ab2f2d0b3a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.805348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef9a3-b301-4b76-aa97-62ab2f2d0b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.823992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e11106ba-169d-4f98-9353-2d94892d1fe7 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:18.825372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e11106ba-169d-4f98-9353-2d94892d1fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:18.829439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d36ef9a3-b301-4b76-aa97-62ab2f2d0b3a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:18.830733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d36ef9a3-b301-4b76-aa97-62ab2f2d0b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:18.837193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:18.839951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:18.920890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 90/179] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:18.922657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3ef0-a4ef-4d10-b3c2-61514d3fa163 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.923090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3ef0-a4ef-4d10-b3c2-61514d3fa163 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.923920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3ef0-a4ef-4d10-b3c2-61514d3fa163 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.925510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 91/180] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:18.926612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e3ef0-a4ef-4d10-b3c2-61514d3fa163 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:18.951104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 90/181] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:18.953822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01323-39f9-41ba-b6a6-93d2d3cde1bd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.955163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01323-39f9-41ba-b6a6-93d2d3cde1bd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.955744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01323-39f9-41ba-b6a6-93d2d3cde1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.997567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b8b01323-39f9-41ba-b6a6-93d2d3cde1bd None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:19.002409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b8b01323-39f9-41ba-b6a6-93d2d3cde1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:19.127536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 91/182] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:19.128368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e3ef0-a4ef-4d10-b3c2-61514d3fa163 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.129981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3af8-ae92-4527-8c6a-46404079424f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.130391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3af8-ae92-4527-8c6a-46404079424f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.130680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3af8-ae92-4527-8c6a-46404079424f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.132799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 92/183] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:19.144765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ece3-0cb6-4bbe-a53e-a554f1d565ed None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.145052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ece3-0cb6-4bbe-a53e-a554f1d565ed None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.145333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ece3-0cb6-4bbe-a53e-a554f1d565ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.165804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-77d9ece3-0cb6-4bbe-a53e-a554f1d565ed None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:19.166417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-77d9ece3-0cb6-4bbe-a53e-a554f1d565ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:19.174158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f6e8-8da2-45eb-9ab1-fd1ba1d46ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.175408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f6e8-8da2-45eb-9ab1-fd1ba1d46ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.175830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f6e8-8da2-45eb-9ab1-fd1ba1d46ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.176264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f6e8-8da2-45eb-9ab1-fd1ba1d46ac9 None admin] PATH_INFO: `/v3/users/f2ea2cda24db4580a183f631c5970850` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.177658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f6e8-8da2-45eb-9ab1-fd1ba1d46ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ea2cda24db4580a183f631c5970850)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:19.180047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f6e8-8da2-45eb-9ab1-fd1ba1d46ac9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:19.182129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 92/184] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:18 2022] GET /identity/v3/users/f2ea2cda24db4580a183f631c5970850 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:19.188529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f6e8-8da2-45eb-9ab1-fd1ba1d46ac9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.207477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:19.268192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 93/185] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:19.268433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:19.310996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f6e8-8da2-45eb-9ab1-fd1ba1d46ac9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.325756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9ece3-0cb6-4bbe-a53e-a554f1d565ed None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.374249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cfe39-f58e-4a8a-a43c-b854f3b7da3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.375261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe39-f58e-4a8a-a43c-b854f3b7da3c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.375744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe39-f58e-4a8a-a43c-b854f3b7da3c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.376334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe39-f58e-4a8a-a43c-b854f3b7da3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.448655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9ece3-0cb6-4bbe-a53e-a554f1d565ed None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.487162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831825f6-c761-4906-933a-202114e03853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.487808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831825f6-c761-4906-933a-202114e03853 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.488086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831825f6-c761-4906-933a-202114e03853 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.488355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831825f6-c761-4906-933a-202114e03853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.493766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cfe39-f58e-4a8a-a43c-b854f3b7da3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:19.495478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cfe39-f58e-4a8a-a43c-b854f3b7da3c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:19.500316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831825f6-c761-4906-933a-202114e03853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-831825f6-c761-4906-933a-202114e03853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:19.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:19.506329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 94/186] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:19.512079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831825f6-c761-4906-933a-202114e03853 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.519477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:19.573574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:19.612824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 93/187] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:19.613945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cfe39-f58e-4a8a-a43c-b854f3b7da3c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.619523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831825f6-c761-4906-933a-202114e03853 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.656501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb5c5-bd76-4a73-8e38-52742b37e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.657148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb5c5-bd76-4a73-8e38-52742b37e6df None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.657426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb5c5-bd76-4a73-8e38-52742b37e6df None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.657694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb5c5-bd76-4a73-8e38-52742b37e6df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bb5c5-bd76-4a73-8e38-52742b37e6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ef2bb5c5-bd76-4a73-8e38-52742b37e6df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:19.673271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:19.674212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 95/188] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:19.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb5c5-bd76-4a73-8e38-52742b37e6df None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.719732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cfe39-f58e-4a8a-a43c-b854f3b7da3c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.734085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:19.755586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.756203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.757050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.757518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.758368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:19.758782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:19.760155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:19.769658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 94/189] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:19.770222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.782896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb5c5-bd76-4a73-8e38-52742b37e6df None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.804261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:19.819763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a54324-2e3e-43c5-8b58-1dbef4e39fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.820401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54324-2e3e-43c5-8b58-1dbef4e39fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.820702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54324-2e3e-43c5-8b58-1dbef4e39fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.820969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54324-2e3e-43c5-8b58-1dbef4e39fc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.830911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a54324-2e3e-43c5-8b58-1dbef4e39fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-89a54324-2e3e-43c5-8b58-1dbef4e39fc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:19.836555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:19.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:19.838808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 96/190] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:19.839448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a54324-2e3e-43c5-8b58-1dbef4e39fc7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.880115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d210539-98f9-4fe2-917f-4ef7ed5b88eb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.915810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b73559-c619-424a-bd2e-eec66c0166ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.916451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73559-c619-424a-bd2e-eec66c0166ab None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.916769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73559-c619-424a-bd2e-eec66c0166ab None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.917049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73559-c619-424a-bd2e-eec66c0166ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.918168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b73559-c619-424a-bd2e-eec66c0166ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:19.919623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b73559-c619-424a-bd2e-eec66c0166ab None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:19.921409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 95/191] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:19.921992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b73559-c619-424a-bd2e-eec66c0166ab None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.942166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a54324-2e3e-43c5-8b58-1dbef4e39fc7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.972210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:19.979036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39162573-1387-40a4-bfd5-e47ed7a4e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.979675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39162573-1387-40a4-bfd5-e47ed7a4e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.979957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39162573-1387-40a4-bfd5-e47ed7a4e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.980231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39162573-1387-40a4-bfd5-e47ed7a4e6b8 None admin] PATH_INFO: `/v3/projects/a2913505014a44f3ba8e5eacf6677d7d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.986483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39162573-1387-40a4-bfd5-e47ed7a4e6b8 None admin] RBAC: Authorizing `identity:get_project(project_id=a2913505014a44f3ba8e5eacf6677d7d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:19.986483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39162573-1387-40a4-bfd5-e47ed7a4e6b8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:19.986483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 97/192] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/projects/a2913505014a44f3ba8e5eacf6677d7d => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:19.986483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39162573-1387-40a4-bfd5-e47ed7a4e6b8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.034115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b73559-c619-424a-bd2e-eec66c0166ab None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.036036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:20.069805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.070499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.070785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.071062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.071727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:20.072032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:20.073446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:20.081833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 96/193] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:20.082486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.090975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39162573-1387-40a4-bfd5-e47ed7a4e6b8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.125610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955baa34-82f0-442d-90d4-1779d18757f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.126217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955baa34-82f0-442d-90d4-1779d18757f8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.126493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955baa34-82f0-442d-90d4-1779d18757f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.126762 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955baa34-82f0-442d-90d4-1779d18757f8 None admin] PATH_INFO: `/v3/users/bda2108873f3422c921424e774b4ca6d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.141358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955baa34-82f0-442d-90d4-1779d18757f8 None admin] RBAC: Authorizing `identity:get_user(user_id=bda2108873f3422c921424e774b4ca6d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:20.142818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955baa34-82f0-442d-90d4-1779d18757f8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:20.144429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 98/194] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/users/bda2108873f3422c921424e774b4ca6d => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:20.145190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955baa34-82f0-442d-90d4-1779d18757f8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.187268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189eb3-094a-4f2e-b74c-5155dfd48196 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.189587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:20.221350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.221962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.222247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.222523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.223195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:20.223556 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:20.224959 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:20.233223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 97/195] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:20.234079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.250308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955baa34-82f0-442d-90d4-1779d18757f8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.258278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:20.284765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a1c9-69e3-49e7-b52f-fa299bf19efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.285330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a1c9-69e3-49e7-b52f-fa299bf19efe None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.285664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a1c9-69e3-49e7-b52f-fa299bf19efe None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.285940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a1c9-69e3-49e7-b52f-fa299bf19efe None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.286586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03a1c9-69e3-49e7-b52f-fa299bf19efe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:20.288703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03a1c9-69e3-49e7-b52f-fa299bf19efe None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:20.336761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca0bf7-f566-459b-8f96-9ac62ad84bae None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.370849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.371444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.371726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.372002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.372763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] RBAC: Adding query filter params (role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=a2913505014a44f3ba8e5eacf6677d7d, user.id=f2ea2cda24db4580a183f631c5970850) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:20.373075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:20.374495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:20.380325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 98/196] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:20 2022] GET /identity/v3/role_assignments?user.id=f2ea2cda24db4580a183f631c5970850&scope.project.id=a2913505014a44f3ba8e5eacf6677d7d&role.id=943b210730ce4efdaa3903233fba5962 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:20.381172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.392712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 99/197] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:49:20 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:20.392712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a1c9-69e3-49e7-b52f-fa299bf19efe None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.424858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:20.533843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b77783-04cd-407f-88b4-2309e609d5a9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.562317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a1c9-69e3-49e7-b52f-fa299bf19efe None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.592325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4f092-5cf0-43f7-88d8-3bcf42d169b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.593239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f092-5cf0-43f7-88d8-3bcf42d169b3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.593526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f092-5cf0-43f7-88d8-3bcf42d169b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.593809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f092-5cf0-43f7-88d8-3bcf42d169b3 None admin] PATH_INFO: `/v3/users/186218ef39cd44318c045b255cf44a20` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.595209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4f092-5cf0-43f7-88d8-3bcf42d169b3 None admin] RBAC: Authorizing `identity:get_user(user_id=186218ef39cd44318c045b255cf44a20)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:20.597368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4f092-5cf0-43f7-88d8-3bcf42d169b3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:20.598978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 99/198] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:20 2022] GET /identity/v3/users/186218ef39cd44318c045b255cf44a20 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:20.599745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4f092-5cf0-43f7-88d8-3bcf42d169b3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.609564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f298573-984c-42de-afb9-8e38ab523f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.610185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f298573-984c-42de-afb9-8e38ab523f3c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.610463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f298573-984c-42de-afb9-8e38ab523f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.610734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f298573-984c-42de-afb9-8e38ab523f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.651150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:20.697603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f298573-984c-42de-afb9-8e38ab523f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:20.699124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f298573-984c-42de-afb9-8e38ab523f3c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:20.729984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:20.734116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4f092-5cf0-43f7-88d8-3bcf42d169b3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.784062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daaaab-687c-4404-acbf-280277adc356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.784948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daaaab-687c-4404-acbf-280277adc356 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.785385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daaaab-687c-4404-acbf-280277adc356 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.785801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daaaab-687c-4404-acbf-280277adc356 None admin] PATH_INFO: `/v3/users/bda2108873f3422c921424e774b4ca6d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.787190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76daaaab-687c-4404-acbf-280277adc356 None admin] RBAC: Authorizing `identity:get_user(user_id=bda2108873f3422c921424e774b4ca6d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:20.789466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76daaaab-687c-4404-acbf-280277adc356 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:20.791295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 100/199] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:20 2022] GET /identity/v3/users/bda2108873f3422c921424e774b4ca6d => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:20.792433 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daaaab-687c-4404-acbf-280277adc356 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.832268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 100/200] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:20.836631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f298573-984c-42de-afb9-8e38ab523f3c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:20.906703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:20.938950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daaaab-687c-4404-acbf-280277adc356 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.947678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f298573-984c-42de-afb9-8e38ab523f3c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:20.985777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec3fb5-7391-40e9-ae45-e5d8f4d26d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.986545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec3fb5-7391-40e9-ae45-e5d8f4d26d75 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.986916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec3fb5-7391-40e9-ae45-e5d8f4d26d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.987280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec3fb5-7391-40e9-ae45-e5d8f4d26d75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:20.987473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ecae6-c92b-4ecf-add3-9330f65c936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:20.988277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ecae6-c92b-4ecf-add3-9330f65c936e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:20.988727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ecae6-c92b-4ecf-add3-9330f65c936e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:20.989161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ecae6-c92b-4ecf-add3-9330f65c936e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.031422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:21.067497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ecae6-c92b-4ecf-add3-9330f65c936e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.069817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ecae6-c92b-4ecf-add3-9330f65c936e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.081819 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec3fb5-7391-40e9-ae45-e5d8f4d26d75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.084272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec3fb5-7391-40e9-ae45-e5d8f4d26d75 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.172750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:21.185581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 101/201] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:21.186975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ecae6-c92b-4ecf-add3-9330f65c936e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:21.228624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 101/202] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:21.229715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec3fb5-7391-40e9-ae45-e5d8f4d26d75 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:21.277965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:21.323577 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ecae6-c92b-4ecf-add3-9330f65c936e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:21.350922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec3fb5-7391-40e9-ae45-e5d8f4d26d75 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:21.363641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb309df-1f27-4998-9541-6dfe352f624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:21.364420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb309df-1f27-4998-9541-6dfe352f624e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.365387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb309df-1f27-4998-9541-6dfe352f624e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb309df-1f27-4998-9541-6dfe352f624e None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.368562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb309df-1f27-4998-9541-6dfe352f624e None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.370112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb309df-1f27-4998-9541-6dfe352f624e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.372201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 102/203] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:21 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:21.373166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb309df-1f27-4998-9541-6dfe352f624e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:21.399043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fef8-f26d-42a8-bce7-06974038a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:21.400008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fef8-f26d-42a8-bce7-06974038a626 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.400470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fef8-f26d-42a8-bce7-06974038a626 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.400948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fef8-f26d-42a8-bce7-06974038a626 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.403282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462fef8-f26d-42a8-bce7-06974038a626 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.405650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462fef8-f26d-42a8-bce7-06974038a626 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.408738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 102/204] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:21 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:21.409960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fef8-f26d-42a8-bce7-06974038a626 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:21.453015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:21.500812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb309df-1f27-4998-9541-6dfe352f624e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:21.548266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab2b8a-a6bf-44b2-9003-e32fc57339e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:21.549230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2b8a-a6bf-44b2-9003-e32fc57339e5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.549652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2b8a-a6bf-44b2-9003-e32fc57339e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.550065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2b8a-a6bf-44b2-9003-e32fc57339e5 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.550453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fef8-f26d-42a8-bce7-06974038a626 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:21.551496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab2b8a-a6bf-44b2-9003-e32fc57339e5 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.554587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab2b8a-a6bf-44b2-9003-e32fc57339e5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.556458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 103/205] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:21 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:21.557424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab2b8a-a6bf-44b2-9003-e32fc57339e5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:21.560375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:21.596061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:21.596898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.597273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.597707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.598536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=165361dc47704cb28d965f63da95703d, user.id=bda2108873f3422c921424e774b4ca6d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:21.599067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.601467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.608585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 103/206] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:21 2022] GET /identity/v3/role_assignments?user.id=bda2108873f3422c921424e774b4ca6d&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:21.609611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:21.685135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab2b8a-a6bf-44b2-9003-e32fc57339e5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:21.719634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:21.727997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c690ba-2cc6-4502-9105-1d4267ef8e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:21.729065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c690ba-2cc6-4502-9105-1d4267ef8e79 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.729347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902f337-9acc-4d08-b9e9-2623f3229a2b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:21.729699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c690ba-2cc6-4502-9105-1d4267ef8e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.730113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c690ba-2cc6-4502-9105-1d4267ef8e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.734081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c690ba-2cc6-4502-9105-1d4267ef8e79 None admin] RBAC: Adding query filter params (role.id=ca153d9f3fae4e60b97c36c60d357c55, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4, user.id=186218ef39cd44318c045b255cf44a20) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:21.734081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c690ba-2cc6-4502-9105-1d4267ef8e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.734081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c690ba-2cc6-4502-9105-1d4267ef8e79 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.742629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 104/207] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:21 2022] GET /identity/v3/role_assignments?user.id=186218ef39cd44318c045b255cf44a20&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=ca153d9f3fae4e60b97c36c60d357c55 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:21.778360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9c4f0-6678-4691-a345-9e88239726d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:21.779166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9c4f0-6678-4691-a345-9e88239726d9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.779555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9c4f0-6678-4691-a345-9e88239726d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.779933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9c4f0-6678-4691-a345-9e88239726d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.780920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9c4f0-6678-4691-a345-9e88239726d9 None admin] RBAC: Adding query filter params (role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=165361dc47704cb28d965f63da95703d, user.id=bda2108873f3422c921424e774b4ca6d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:21.781360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9c4f0-6678-4691-a345-9e88239726d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:21.783025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9c4f0-6678-4691-a345-9e88239726d9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:21.790899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 104/208] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:21 2022] GET /identity/v3/role_assignments?user.id=bda2108873f3422c921424e774b4ca6d&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:22.954255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab131-f742-44e7-b59a-89b84d33489d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:22.954796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab131-f742-44e7-b59a-89b84d33489d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:22.954796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab131-f742-44e7-b59a-89b84d33489d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:22.956314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 105/209] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:22.962372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a64a1-fa31-4722-b02e-57aa402ec562 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:22.962786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a64a1-fa31-4722-b02e-57aa402ec562 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:22.962974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a64a1-fa31-4722-b02e-57aa402ec562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:22.981742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f12a64a1-fa31-4722-b02e-57aa402ec562 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:22.982928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f12a64a1-fa31-4722-b02e-57aa402ec562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:23.031216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcbb3-5830-4aef-b136-59edde486ccd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:23.031451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcbb3-5830-4aef-b136-59edde486ccd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:23.031698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcbb3-5830-4aef-b136-59edde486ccd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:23.033068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 106/210] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:23.038526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d7758-d142-45ba-8e79-75606299aea0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:23.038900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d7758-d142-45ba-8e79-75606299aea0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:23.039189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d7758-d142-45ba-8e79-75606299aea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:23.059044 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 105/211] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:23.060315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a90d7758-d142-45ba-8e79-75606299aea0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:23.068503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a90d7758-d142-45ba-8e79-75606299aea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:23.129109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:23.136718 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 107/212] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:23.342956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a64a1-fa31-4722-b02e-57aa402ec562 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:23.415291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d7758-d142-45ba-8e79-75606299aea0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:23.443020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:23.461587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a64a1-fa31-4722-b02e-57aa402ec562 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:23.508428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212159b8-1461-40c1-ad88-5add1d56d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:23.508428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212159b8-1461-40c1-ad88-5add1d56d42b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:23.508428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212159b8-1461-40c1-ad88-5add1d56d42b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:23.508428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212159b8-1461-40c1-ad88-5add1d56d42b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:23.513338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212159b8-1461-40c1-ad88-5add1d56d42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-212159b8-1461-40c1-ad88-5add1d56d42b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:23.518705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:23.519775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:23.520588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:23.526684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 106/213] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:23.527783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212159b8-1461-40c1-ad88-5add1d56d42b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:23.547704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d7758-d142-45ba-8e79-75606299aea0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:23.597221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080707f-152d-4f93-ae1f-721dfea4a17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:23.598096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080707f-152d-4f93-ae1f-721dfea4a17c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:23.598547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080707f-152d-4f93-ae1f-721dfea4a17c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:23.599520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080707f-152d-4f93-ae1f-721dfea4a17c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:23.602789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080707f-152d-4f93-ae1f-721dfea4a17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:23.605570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080707f-152d-4f93-ae1f-721dfea4a17c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:23.609105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 108/214] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:23.614915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080707f-152d-4f93-ae1f-721dfea4a17c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:23.651884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212159b8-1461-40c1-ad88-5add1d56d42b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:23.690341 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:23.691047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:23.692442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:23.692964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:23.693445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:23.695025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:23.695631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:23.697380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:23.707100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 107/215] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:23.713261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:23.733274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:23.735737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080707f-152d-4f93-ae1f-721dfea4a17c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:23.776551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf2ecb-c3dc-49bd-be8c-cfbcb9ccd498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:23.777203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2ecb-c3dc-49bd-be8c-cfbcb9ccd498 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:23.777485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2ecb-c3dc-49bd-be8c-cfbcb9ccd498 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:23.777759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2ecb-c3dc-49bd-be8c-cfbcb9ccd498 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:23.778416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf2ecb-c3dc-49bd-be8c-cfbcb9ccd498 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:23.779936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf2ecb-c3dc-49bd-be8c-cfbcb9ccd498 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:23.841111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bdb61-4f34-446a-ae45-d4e29e934b19 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:23.881329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda4f60-b68a-423e-932b-9f862011eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:23.881938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4f60-b68a-423e-932b-9f862011eb4f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:23.882221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4f60-b68a-423e-932b-9f862011eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:23.882498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4f60-b68a-423e-932b-9f862011eb4f None admin] PATH_INFO: `/v3/users/1b80fba4f3d4424dac70bdeffc904a4a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:23.896707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda4f60-b68a-423e-932b-9f862011eb4f None admin] RBAC: Authorizing `identity:get_user(user_id=1b80fba4f3d4424dac70bdeffc904a4a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:23.899518 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda4f60-b68a-423e-932b-9f862011eb4f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:23.901470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 108/216] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:23 2022] GET /identity/v3/users/1b80fba4f3d4424dac70bdeffc904a4a => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:23.906848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda4f60-b68a-423e-932b-9f862011eb4f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:23.941794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 109/217] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:49:23 2022] POST /identity/v3/users => generated 297 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:49:24.017153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:24.043542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda4f60-b68a-423e-932b-9f862011eb4f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:24.085349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75c70-a1cc-4983-9b0a-90b8756edeac None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.085896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75c70-a1cc-4983-9b0a-90b8756edeac None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.086137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75c70-a1cc-4983-9b0a-90b8756edeac None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.087692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 110/218] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:24.090135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb8fb-4554-425e-8b14-55e295a5b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:24.091024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb8fb-4554-425e-8b14-55e295a5b9ad None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.091504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb8fb-4554-425e-8b14-55e295a5b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.092029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdb8fb-4554-425e-8b14-55e295a5b9ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.093043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b8442-acf0-4fa8-9b9f-62657e85e63b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.093330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b8442-acf0-4fa8-9b9f-62657e85e63b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.093608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b8442-acf0-4fa8-9b9f-62657e85e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.113232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c36b8442-acf0-4fa8-9b9f-62657e85e63b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:24.114645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c36b8442-acf0-4fa8-9b9f-62657e85e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:24.175131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdb8fb-4554-425e-8b14-55e295a5b9ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:24.176629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdb8fb-4554-425e-8b14-55e295a5b9ad None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:24.194404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 111/219] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:24.195715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a08a4-bedf-4faf-a352-e1d66f0e9db2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.195962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a08a4-bedf-4faf-a352-e1d66f0e9db2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.196240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a08a4-bedf-4faf-a352-e1d66f0e9db2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.197918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 112/220] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:24.203458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b6fd-7aaf-4447-89ec-a5a2d6afd998 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.203629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b6fd-7aaf-4447-89ec-a5a2d6afd998 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.203808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b6fd-7aaf-4447-89ec-a5a2d6afd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.228832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f8a5b6fd-7aaf-4447-89ec-a5a2d6afd998 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:24.228832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f8a5b6fd-7aaf-4447-89ec-a5a2d6afd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:24.276122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:24.289786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:24.317819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 113/221] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:24.321289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 109/222] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:24.328778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b6fd-7aaf-4447-89ec-a5a2d6afd998 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:24.439801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b6fd-7aaf-4447-89ec-a5a2d6afd998 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:24.478856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7f27c-9028-4590-8299-7e84ef9c3858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:24.479579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7f27c-9028-4590-8299-7e84ef9c3858 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.479905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7f27c-9028-4590-8299-7e84ef9c3858 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.480185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7f27c-9028-4590-8299-7e84ef9c3858 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.481353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7f27c-9028-4590-8299-7e84ef9c3858 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:24.482867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7f27c-9028-4590-8299-7e84ef9c3858 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:24.488587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 114/223] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:24 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:24.491394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb8fb-4554-425e-8b14-55e295a5b9ad None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:24.505383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7f27c-9028-4590-8299-7e84ef9c3858 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:24.588454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:24.651733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdb8fb-4554-425e-8b14-55e295a5b9ad None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:24.656878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7f27c-9028-4590-8299-7e84ef9c3858 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:24.687802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:24.688590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.689001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.689366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.690256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] RBAC: Adding query filter params (role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=165361dc47704cb28d965f63da95703d, user.id=1b80fba4f3d4424dac70bdeffc904a4a) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:24.690607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:24.692189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:24.695750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766d100-c0db-45e2-be56-20c8c66e8e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:24.696392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766d100-c0db-45e2-be56-20c8c66e8e3d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.696962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766d100-c0db-45e2-be56-20c8c66e8e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.697239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766d100-c0db-45e2-be56-20c8c66e8e3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.698775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 110/224] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:24 2022] GET /identity/v3/role_assignments?user.id=1b80fba4f3d4424dac70bdeffc904a4a&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=943b210730ce4efdaa3903233fba5962 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:24.699686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:24.708444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766d100-c0db-45e2-be56-20c8c66e8e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3766d100-c0db-45e2-be56-20c8c66e8e3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:24.714751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:24.715919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:24.716960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 115/225] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:24.722418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766d100-c0db-45e2-be56-20c8c66e8e3d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:24.760248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:24.915725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7b02-4f3f-44e6-8c02-c920fa817909 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:24.918954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766d100-c0db-45e2-be56-20c8c66e8e3d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:24.929839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:24.955058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749c4bb-a9ab-470a-85c9-809edfc28710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:24.955668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c4bb-a9ab-470a-85c9-809edfc28710 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.955944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c4bb-a9ab-470a-85c9-809edfc28710 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.956271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c4bb-a9ab-470a-85c9-809edfc28710 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.961591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:24.962764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:24.963420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:24.963908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:24.964930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:24.965518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:24.967108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:24.968007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749c4bb-a9ab-470a-85c9-809edfc28710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-8749c4bb-a9ab-470a-85c9-809edfc28710 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:24.973312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:24.974228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:24.975001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 111/226] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:24.983125 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749c4bb-a9ab-470a-85c9-809edfc28710 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:24.983991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 116/227] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:24.992088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:25.152946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:25.169731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749c4bb-a9ab-470a-85c9-809edfc28710 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:25.191827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e711a-3b2a-4bc0-bff2-722a65d81d59 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:25.244244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:25.244800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.245962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.246242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.248002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:25.248303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:25.250406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:25.261537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa4c0b-ad25-4de4-b152-3422a994a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:25.262183 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4c0b-ad25-4de4-b152-3422a994a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.262458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4c0b-ad25-4de4-b152-3422a994a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.262727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4c0b-ad25-4de4-b152-3422a994a7e2 None admin] PATH_INFO: `/v3/users/bda2108873f3422c921424e774b4ca6d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.264355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa4c0b-ad25-4de4-b152-3422a994a7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=bda2108873f3422c921424e774b4ca6d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:25.265974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa4c0b-ad25-4de4-b152-3422a994a7e2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:25.267917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 117/228] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:24 2022] GET /identity/v3/users/bda2108873f3422c921424e774b4ca6d => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:25.273443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa4c0b-ad25-4de4-b152-3422a994a7e2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:25.274799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 112/229] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:25.280066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:25.344876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:25.421602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa4c0b-ad25-4de4-b152-3422a994a7e2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:25.484888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d6a1-527a-44cc-80e9-b68bf8379101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:25.485535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d6a1-527a-44cc-80e9-b68bf8379101 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.485811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d6a1-527a-44cc-80e9-b68bf8379101 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.486080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d6a1-527a-44cc-80e9-b68bf8379101 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.488117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0d6a1-527a-44cc-80e9-b68bf8379101 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:25.489606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0d6a1-527a-44cc-80e9-b68bf8379101 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:25.493327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca959a-bb5e-4a10-9d77-01e20a67840d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:25.496039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 118/230] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:25 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:25.502823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d6a1-527a-44cc-80e9-b68bf8379101 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:25.566107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b3b03-0bd3-4e41-aa6c-52d2e3b74342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:25.566757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b3b03-0bd3-4e41-aa6c-52d2e3b74342 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.567054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b3b03-0bd3-4e41-aa6c-52d2e3b74342 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.567509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b3b03-0bd3-4e41-aa6c-52d2e3b74342 None admin] PATH_INFO: `/v3/users/bda2108873f3422c921424e774b4ca6d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.571203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b3b03-0bd3-4e41-aa6c-52d2e3b74342 None admin] RBAC: Authorizing `identity:get_user(user_id=bda2108873f3422c921424e774b4ca6d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:25.572710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b3b03-0bd3-4e41-aa6c-52d2e3b74342 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:25.574325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 113/231] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:25 2022] GET /identity/v3/users/bda2108873f3422c921424e774b4ca6d => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:25.579744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b3b03-0bd3-4e41-aa6c-52d2e3b74342 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:25.624227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:25.685645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d6a1-527a-44cc-80e9-b68bf8379101 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:25.720846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:25.727798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50071dac-c9fa-4eee-849f-a8baefc121c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:25.731214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071dac-c9fa-4eee-849f-a8baefc121c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.731538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071dac-c9fa-4eee-849f-a8baefc121c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.731823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071dac-c9fa-4eee-849f-a8baefc121c2 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d/users/bda2108873f3422c921424e774b4ca6d/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.737334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50071dac-c9fa-4eee-849f-a8baefc121c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=165361dc47704cb28d965f63da95703d, user_id=bda2108873f3422c921424e774b4ca6d, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:25.738837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50071dac-c9fa-4eee-849f-a8baefc121c2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:25.772908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b3b03-0bd3-4e41-aa6c-52d2e3b74342 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:25.810783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbb21b-64ed-44eb-9588-e994154493fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:25.811460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbb21b-64ed-44eb-9588-e994154493fd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.811747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbb21b-64ed-44eb-9588-e994154493fd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.812023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbb21b-64ed-44eb-9588-e994154493fd None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.813230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbb21b-64ed-44eb-9588-e994154493fd None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:25.814679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbb21b-64ed-44eb-9588-e994154493fd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:25.816721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 114/232] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:25 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:25.822858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbb21b-64ed-44eb-9588-e994154493fd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:25.884714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 119/233] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:25 2022] PUT /identity/v3/projects/165361dc47704cb28d965f63da95703d/users/bda2108873f3422c921424e774b4ca6d/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:49:25.932012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:25.945745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbb21b-64ed-44eb-9588-e994154493fd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:25.990985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2b291-d7cc-446a-b605-eca971c3f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:25.992565 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b291-d7cc-446a-b605-eca971c3f717 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.992939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b291-d7cc-446a-b605-eca971c3f717 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.993278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b291-d7cc-446a-b605-eca971c3f717 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d/users/bda2108873f3422c921424e774b4ca6d/roles/3b586edbe9c24d7288ee1a8e48781662` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.995698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2b291-d7cc-446a-b605-eca971c3f717 None admin] RBAC: Authorizing `identity:create_grant(project_id=165361dc47704cb28d965f63da95703d, user_id=bda2108873f3422c921424e774b4ca6d, role_id=3b586edbe9c24d7288ee1a8e48781662)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:25.997283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2b291-d7cc-446a-b605-eca971c3f717 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:26.142105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 115/234] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:25 2022] PUT /identity/v3/projects/165361dc47704cb28d965f63da95703d/users/bda2108873f3422c921424e774b4ca6d/roles/3b586edbe9c24d7288ee1a8e48781662 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:26.761219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3ff3-ef8b-43d5-bf5f-550e103c0a78 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:26.761219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3ff3-ef8b-43d5-bf5f-550e103c0a78 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:26.761219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3ff3-ef8b-43d5-bf5f-550e103c0a78 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:26.762316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 120/235] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:26.767908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ebca6-a9f6-442c-aaa7-4073b7506ee0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:26.768798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ebca6-a9f6-442c-aaa7-4073b7506ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:26.769286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ebca6-a9f6-442c-aaa7-4073b7506ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:26.791140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-209ebca6-a9f6-442c-aaa7-4073b7506ee0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:26.792706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-209ebca6-a9f6-442c-aaa7-4073b7506ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:26.850768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eafba1-324d-470f-8e88-5db6a05267a0 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:26.851164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eafba1-324d-470f-8e88-5db6a05267a0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:26.851384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eafba1-324d-470f-8e88-5db6a05267a0 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:26.852999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 121/236] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:26.858146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0c548-88a6-468e-844a-6dea488ad861 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:26.858430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0c548-88a6-468e-844a-6dea488ad861 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:26.858709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0c548-88a6-468e-844a-6dea488ad861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:26.878105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-58c0c548-88a6-468e-844a-6dea488ad861 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:26.879591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-58c0c548-88a6-468e-844a-6dea488ad861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:26.886283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 116/237] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:26.953087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 122/238] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:27.181787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ebca6-a9f6-442c-aaa7-4073b7506ee0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:27.254862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0c548-88a6-468e-844a-6dea488ad861 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:27.281454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:27.301209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ebca6-a9f6-442c-aaa7-4073b7506ee0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:27.348744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff53fe-2f27-42bf-8bc2-45a7b15caa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:27.352269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff53fe-2f27-42bf-8bc2-45a7b15caa08 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:27.352269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff53fe-2f27-42bf-8bc2-45a7b15caa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:27.352269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff53fe-2f27-42bf-8bc2-45a7b15caa08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:27.352269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff53fe-2f27-42bf-8bc2-45a7b15caa08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:27.354193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff53fe-2f27-42bf-8bc2-45a7b15caa08 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:27.356694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 117/239] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:27.357945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bf5a-6af7-469f-8f95-28c86aeccf71 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:27.358233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bf5a-6af7-469f-8f95-28c86aeccf71 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:27.358505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bf5a-6af7-469f-8f95-28c86aeccf71 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:27.359714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 118/240] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:27.364859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165bf5a-6af7-469f-8f95-28c86aeccf71 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:27.370370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:27.378269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0c548-88a6-468e-844a-6dea488ad861 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:27.420892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a244d-9ceb-43d7-9fd1-acaca5fbd98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:27.421620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a244d-9ceb-43d7-9fd1-acaca5fbd98a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:27.421964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a244d-9ceb-43d7-9fd1-acaca5fbd98a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:27.422356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a244d-9ceb-43d7-9fd1-acaca5fbd98a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:27.439274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a244d-9ceb-43d7-9fd1-acaca5fbd98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-789a244d-9ceb-43d7-9fd1-acaca5fbd98a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:27.444869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:27.445995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:27.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:27.451092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 123/241] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:49:27.453050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dd10-71b7-4669-a624-07174a97e96b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:27.453405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dd10-71b7-4669-a624-07174a97e96b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:27.453750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dd10-71b7-4669-a624-07174a97e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:27.501790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8580dd10-71b7-4669-a624-07174a97e96b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:27.503097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8580dd10-71b7-4669-a624-07174a97e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:27.529756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165bf5a-6af7-469f-8f95-28c86aeccf71 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:27.577517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8bda0-396a-4f1b-8ea7-d3e8fa8af7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:27.578132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8bda0-396a-4f1b-8ea7-d3e8fa8af7f6 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:27.578412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8bda0-396a-4f1b-8ea7-d3e8fa8af7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:27.578794 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8bda0-396a-4f1b-8ea7-d3e8fa8af7f6 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:27.579549 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8bda0-396a-4f1b-8ea7-d3e8fa8af7f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:27.581033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8bda0-396a-4f1b-8ea7-d3e8fa8af7f6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:27.584258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 124/242] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:27.585303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580dd10-71b7-4669-a624-07174a97e96b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:27.688863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:27.693090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580dd10-71b7-4669-a624-07174a97e96b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:27.711525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 119/243] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:49:27 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:27.743043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:27.743670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:27.743946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:27.744216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:27.744909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:27.745256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:27.746630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:27.766777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 125/244] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:27.773231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8bda0-396a-4f1b-8ea7-d3e8fa8af7f6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:27.783859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:27.911186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8bda0-396a-4f1b-8ea7-d3e8fa8af7f6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:27.950994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb44adf-f8b6-4c16-82b9-a62487de41e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:27.951563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44adf-f8b6-4c16-82b9-a62487de41e2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:27.951841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44adf-f8b6-4c16-82b9-a62487de41e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:27.952116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44adf-f8b6-4c16-82b9-a62487de41e2 None admin] PATH_INFO: `/v3/users/166c862e7c104d15a00e5d590d0c1b66` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:27.967594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb44adf-f8b6-4c16-82b9-a62487de41e2 None admin] RBAC: Authorizing `identity:get_user(user_id=166c862e7c104d15a00e5d590d0c1b66)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:27.969125 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb44adf-f8b6-4c16-82b9-a62487de41e2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:27.971152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 120/245] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:27 2022] GET /identity/v3/users/166c862e7c104d15a00e5d590d0c1b66 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:27.976669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:28.016515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb44adf-f8b6-4c16-82b9-a62487de41e2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:28.104505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.104696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f752c0e-34a1-445f-a8b1-57ef792611c2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:28.148237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26062bd7-9e7b-4dbf-8b9b-08a8b68a3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:28.148973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26062bd7-9e7b-4dbf-8b9b-08a8b68a3a74 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.149263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26062bd7-9e7b-4dbf-8b9b-08a8b68a3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.149538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26062bd7-9e7b-4dbf-8b9b-08a8b68a3a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.167455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb44adf-f8b6-4c16-82b9-a62487de41e2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:28.171375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.215323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692f990-c359-4bfe-be97-61a1452f84fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:28.215535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692f990-c359-4bfe-be97-61a1452f84fc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.216201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692f990-c359-4bfe-be97-61a1452f84fc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.216201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692f990-c359-4bfe-be97-61a1452f84fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.230358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692f990-c359-4bfe-be97-61a1452f84fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:28.234528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26062bd7-9e7b-4dbf-8b9b-08a8b68a3a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c692f990-c359-4bfe-be97-61a1452f84fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:28.235734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:28.236622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:28.237485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 121/246] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:28.238854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26062bd7-9e7b-4dbf-8b9b-08a8b68a3a74 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:28.244258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692f990-c359-4bfe-be97-61a1452f84fc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:28.374297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 126/247] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:28.380670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26062bd7-9e7b-4dbf-8b9b-08a8b68a3a74 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:28.394051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692f990-c359-4bfe-be97-61a1452f84fc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:28.421655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.440999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:28.442202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.442637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.443058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.445493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:28.446015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:28.451793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:28.452261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.459368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 122/248] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:28.469670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:28.518854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26062bd7-9e7b-4dbf-8b9b-08a8b68a3a74 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:28.567316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26fd4-01c7-41df-af5e-752aeb770bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:28.568584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26fd4-01c7-41df-af5e-752aeb770bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.568936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26fd4-01c7-41df-af5e-752aeb770bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.569219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26fd4-01c7-41df-af5e-752aeb770bc7 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.570832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26fd4-01c7-41df-af5e-752aeb770bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:28.572579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26fd4-01c7-41df-af5e-752aeb770bc7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:28.576545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 127/249] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:28 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:28.580807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8ee5-9a7c-4df9-ada9-a80611b0b13b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.581101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8ee5-9a7c-4df9-ada9-a80611b0b13b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.581379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8ee5-9a7c-4df9-ada9-a80611b0b13b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.583022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 128/250] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:28.586688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8ee5-9a7c-4df9-ada9-a80611b0b13b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:28.621103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded2aa3-a7dd-45c3-8441-a312ace1d349 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:28.675954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15c02d-3b12-4500-a0b2-fa594c88e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:28.676635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c02d-3b12-4500-a0b2-fa594c88e5fb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.676918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c02d-3b12-4500-a0b2-fa594c88e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.677190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c02d-3b12-4500-a0b2-fa594c88e5fb None admin] PATH_INFO: `/v3/users/1b80fba4f3d4424dac70bdeffc904a4a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.680725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15c02d-3b12-4500-a0b2-fa594c88e5fb None admin] RBAC: Authorizing `identity:get_user(user_id=1b80fba4f3d4424dac70bdeffc904a4a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:28.685881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15c02d-3b12-4500-a0b2-fa594c88e5fb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:28.687330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 123/251] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:28 2022] GET /identity/v3/users/1b80fba4f3d4424dac70bdeffc904a4a => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:28.688577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8667da-b0e8-4b39-90d6-f788211c5177 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.688935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8667da-b0e8-4b39-90d6-f788211c5177 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.689212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8667da-b0e8-4b39-90d6-f788211c5177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.726692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5a8667da-b0e8-4b39-90d6-f788211c5177 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:28.727863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5a8667da-b0e8-4b39-90d6-f788211c5177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:28.778656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8ee5-9a7c-4df9-ada9-a80611b0b13b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:28.805445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.837089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.847730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:28.848407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.848721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.853064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.853064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] RBAC: Adding query filter params (role.id=ca153d9f3fae4e60b97c36c60d357c55, scope.project.id=165361dc47704cb28d965f63da95703d, user.id=166c862e7c104d15a00e5d590d0c1b66) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:28.853064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:28.853064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:28.864281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 129/252] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:28 2022] GET /identity/v3/role_assignments?user.id=166c862e7c104d15a00e5d590d0c1b66&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=ca153d9f3fae4e60b97c36c60d357c55 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:28.871361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:28.882266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 124/253] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:29.029238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aee6ad-fc37-4e24-aac7-70cd6e500fa5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:29.031286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52ac63-e2e6-465e-9317-4f5fa43b135a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:29.031572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52ac63-e2e6-465e-9317-4f5fa43b135a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:29.031854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52ac63-e2e6-465e-9317-4f5fa43b135a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:29.033379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 125/254] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:29.051663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5827f-d7aa-4b8b-b752-43cbd37112f3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:29.051974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5827f-d7aa-4b8b-b752-43cbd37112f3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:29.052220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5827f-d7aa-4b8b-b752-43cbd37112f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:29.083525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-49c5827f-d7aa-4b8b-b752-43cbd37112f3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:29.085328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-49c5827f-d7aa-4b8b-b752-43cbd37112f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:29.120463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895826e-e09d-4e69-8961-6c209c0d5baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:29.121154 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895826e-e09d-4e69-8961-6c209c0d5baa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:29.121442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895826e-e09d-4e69-8961-6c209c0d5baa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:29.121725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895826e-e09d-4e69-8961-6c209c0d5baa None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:29.122917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895826e-e09d-4e69-8961-6c209c0d5baa None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:29.125674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895826e-e09d-4e69-8961-6c209c0d5baa None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:29.135702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 130/255] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:28 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:29.142489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895826e-e09d-4e69-8961-6c209c0d5baa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:29.275586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 126/256] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 19 14:49:29.276554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:29.277668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5827f-d7aa-4b8b-b752-43cbd37112f3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:29.418667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895826e-e09d-4e69-8961-6c209c0d5baa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:29.488421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5827f-d7aa-4b8b-b752-43cbd37112f3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:29.509216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b043c3-e925-467f-b6d4-b195a99527b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:29.509906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b043c3-e925-467f-b6d4-b195a99527b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:29.510187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b043c3-e925-467f-b6d4-b195a99527b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:29.510463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b043c3-e925-467f-b6d4-b195a99527b8 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d/users/1b80fba4f3d4424dac70bdeffc904a4a/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:29.512520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b043c3-e925-467f-b6d4-b195a99527b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=165361dc47704cb28d965f63da95703d, user_id=1b80fba4f3d4424dac70bdeffc904a4a, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:29.513965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b043c3-e925-467f-b6d4-b195a99527b8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:29.517555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:29.557463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de978f3-aa99-4c55-ac56-200332a1ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:29.558116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de978f3-aa99-4c55-ac56-200332a1ec91 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:29.558457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de978f3-aa99-4c55-ac56-200332a1ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:29.558737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de978f3-aa99-4c55-ac56-200332a1ec91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:29.572133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de978f3-aa99-4c55-ac56-200332a1ec91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2de978f3-aa99-4c55-ac56-200332a1ec91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:29.577300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:29.578165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:29.579312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 127/257] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:29.585005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de978f3-aa99-4c55-ac56-200332a1ec91 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:29.666948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 131/258] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:29 2022] PUT /identity/v3/projects/165361dc47704cb28d965f63da95703d/users/1b80fba4f3d4424dac70bdeffc904a4a/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:29.726507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de978f3-aa99-4c55-ac56-200332a1ec91 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:29.757643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b043c3-e925-467f-b6d4-b195a99527b8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:29.821301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:29.821943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:29.822223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:29.822500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:29.823192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:29.823496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:29.824982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:29.851979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 128/259] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:29.858297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:29.935165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:29.983843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b043c3-e925-467f-b6d4-b195a99527b8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:29.995653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:30.034678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cec8b-f613-4ebc-af20-e4f69f521060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:30.035578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cec8b-f613-4ebc-af20-e4f69f521060 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:30.037054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cec8b-f613-4ebc-af20-e4f69f521060 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:30.037054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cec8b-f613-4ebc-af20-e4f69f521060 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:30.055308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6680-fb2d-4bed-8b34-43cd18d54345 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:30.073501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cec8b-f613-4ebc-af20-e4f69f521060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-823cec8b-f613-4ebc-af20-e4f69f521060 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:30.078395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:30.079335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:30.080209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 132/260] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:30.085770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cec8b-f613-4ebc-af20-e4f69f521060 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:30.129981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73884b5-5044-401c-a296-ef3be6e1ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:30.130890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73884b5-5044-401c-a296-ef3be6e1ca29 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:30.131206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73884b5-5044-401c-a296-ef3be6e1ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:30.132355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73884b5-5044-401c-a296-ef3be6e1ca29 None admin] PATH_INFO: `/v3/users/bda2108873f3422c921424e774b4ca6d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:30.133789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73884b5-5044-401c-a296-ef3be6e1ca29 None admin] RBAC: Authorizing `identity:get_user(user_id=bda2108873f3422c921424e774b4ca6d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:30.135253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73884b5-5044-401c-a296-ef3be6e1ca29 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:30.146318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 129/261] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:29 2022] GET /identity/v3/users/bda2108873f3422c921424e774b4ca6d => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:30.153247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73884b5-5044-401c-a296-ef3be6e1ca29 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:30.344161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cec8b-f613-4ebc-af20-e4f69f521060 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:30.406221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:30.406852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:30.407139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:30.407416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:30.408088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:30.408395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:30.409933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:30.412953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73884b5-5044-401c-a296-ef3be6e1ca29 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:30.414738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:30.426735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 133/262] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:30.433275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:30.473020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:30.505779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62545c-91b5-441b-8150-730d971093da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:30.507308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62545c-91b5-441b-8150-730d971093da None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:30.507792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62545c-91b5-441b-8150-730d971093da None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:30.508286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62545c-91b5-441b-8150-730d971093da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:30.594090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4556721-03cb-4027-a9b7-9e18f822ab6d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:30.656530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d16159-3b1f-4a6a-8c77-ff7173a8c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:30.657104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d16159-3b1f-4a6a-8c77-ff7173a8c1db None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:30.657388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d16159-3b1f-4a6a-8c77-ff7173a8c1db None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:30.657711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d16159-3b1f-4a6a-8c77-ff7173a8c1db None admin] PATH_INFO: `/v3/users/bda2108873f3422c921424e774b4ca6d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:30.658995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d16159-3b1f-4a6a-8c77-ff7173a8c1db None admin] RBAC: Authorizing `identity:get_user(user_id=bda2108873f3422c921424e774b4ca6d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:30.660509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d16159-3b1f-4a6a-8c77-ff7173a8c1db None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:30.662576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 134/263] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:30 2022] GET /identity/v3/users/bda2108873f3422c921424e774b4ca6d => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:30.668148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d16159-3b1f-4a6a-8c77-ff7173a8c1db None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:30.685619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62545c-91b5-441b-8150-730d971093da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:30.696685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62545c-91b5-441b-8150-730d971093da None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:30.857697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 130/264] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:30.869812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62545c-91b5-441b-8150-730d971093da None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:30.872760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:30.888826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:30.898598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d16159-3b1f-4a6a-8c77-ff7173a8c1db None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:30.994188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0daf04-386a-4eda-87bb-3375a7f67354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:30.994811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0daf04-386a-4eda-87bb-3375a7f67354 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:30.995056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0daf04-386a-4eda-87bb-3375a7f67354 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:30.995271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0daf04-386a-4eda-87bb-3375a7f67354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.033778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62545c-91b5-441b-8150-730d971093da None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:31.103255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0daf04-386a-4eda-87bb-3375a7f67354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:31.104851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0daf04-386a-4eda-87bb-3375a7f67354 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:31.105907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36b5a-7ea8-455c-bee6-944e37742328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:31.106552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36b5a-7ea8-455c-bee6-944e37742328 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.106827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36b5a-7ea8-455c-bee6-944e37742328 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.107097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36b5a-7ea8-455c-bee6-944e37742328 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.109150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a36b5a-7ea8-455c-bee6-944e37742328 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:31.110583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a36b5a-7ea8-455c-bee6-944e37742328 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:31.112537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 131/265] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:30 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:31.121560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36b5a-7ea8-455c-bee6-944e37742328 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:31.276064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:31.283299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:31.293809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 135/266] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:31.296827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8a12-9f0c-4c0e-8a68-6aeeb2c599b8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.297733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8a12-9f0c-4c0e-8a68-6aeeb2c599b8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.298240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8a12-9f0c-4c0e-8a68-6aeeb2c599b8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.300266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 136/267] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:31.301989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e8a12-9f0c-4c0e-8a68-6aeeb2c599b8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:31.344758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36b5a-7ea8-455c-bee6-944e37742328 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:31.420207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329503e3-2224-48ed-95b9-3179e331c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:31.421268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329503e3-2224-48ed-95b9-3179e331c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.421964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329503e3-2224-48ed-95b9-3179e331c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.423110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329503e3-2224-48ed-95b9-3179e331c5d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.424308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329503e3-2224-48ed-95b9-3179e331c5d8 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=165361dc47704cb28d965f63da95703d, user.id=bda2108873f3422c921424e774b4ca6d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:31.425531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329503e3-2224-48ed-95b9-3179e331c5d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:31.427417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329503e3-2224-48ed-95b9-3179e331c5d8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:31.440294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 132/268] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:31 2022] GET /identity/v3/role_assignments?user.id=bda2108873f3422c921424e774b4ca6d&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:31.443148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4114a3-6d87-4c3a-8a07-011134e9d76a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.444536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4114a3-6d87-4c3a-8a07-011134e9d76a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.455003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4114a3-6d87-4c3a-8a07-011134e9d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.475203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7b4114a3-6d87-4c3a-8a07-011134e9d76a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:31.479841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7b4114a3-6d87-4c3a-8a07-011134e9d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:31.517344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e8a12-9f0c-4c0e-8a68-6aeeb2c599b8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:31.600656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753069b1-7569-4da5-b394-81a8e8435683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:31.601289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753069b1-7569-4da5-b394-81a8e8435683 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.601567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753069b1-7569-4da5-b394-81a8e8435683 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.601879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753069b1-7569-4da5-b394-81a8e8435683 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.605186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753069b1-7569-4da5-b394-81a8e8435683 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:31.606682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753069b1-7569-4da5-b394-81a8e8435683 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:31.608408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 137/269] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:31 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:31.609612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e0d4-abdd-41f8-a1da-6c19d90436ba None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.609886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e0d4-abdd-41f8-a1da-6c19d90436ba None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.616334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3e0d4-abdd-41f8-a1da-6c19d90436ba None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.620732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 138/270] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:31.621591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e0d4-abdd-41f8-a1da-6c19d90436ba None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:31.639932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 133/271] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:31.642805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136294d8-ca94-4b0e-bf7c-ebc8ead2a754 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.643093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136294d8-ca94-4b0e-bf7c-ebc8ead2a754 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.643364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136294d8-ca94-4b0e-bf7c-ebc8ead2a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.679128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-136294d8-ca94-4b0e-bf7c-ebc8ead2a754 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:31.680355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-136294d8-ca94-4b0e-bf7c-ebc8ead2a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:31.728668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:31.768373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3e0d4-abdd-41f8-a1da-6c19d90436ba None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:31.809197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad932b77-b65b-436e-9c4d-a451434452d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:31.810112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad932b77-b65b-436e-9c4d-a451434452d8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.810821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad932b77-b65b-436e-9c4d-a451434452d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.811094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad932b77-b65b-436e-9c4d-a451434452d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.811829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad932b77-b65b-436e-9c4d-a451434452d8 None admin] RBAC: Adding query filter params (role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=165361dc47704cb28d965f63da95703d, user.id=bda2108873f3422c921424e774b4ca6d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:31.812133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad932b77-b65b-436e-9c4d-a451434452d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:31.813838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad932b77-b65b-436e-9c4d-a451434452d8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:31.822274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 139/272] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:31 2022] GET /identity/v3/role_assignments?user.id=bda2108873f3422c921424e774b4ca6d&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:31.840623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:31.840803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efabac-d660-47cc-a0fd-bcd53106ef39 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.841001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efabac-d660-47cc-a0fd-bcd53106ef39 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.841256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efabac-d660-47cc-a0fd-bcd53106ef39 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.843121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 140/273] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:31.848997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1709-d04e-49ef-a4b9-f4ed713039f6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.849283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1709-d04e-49ef-a4b9-f4ed713039f6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.849536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1709-d04e-49ef-a4b9-f4ed713039f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.861114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 134/274] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:31.882781 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-da6f1709-d04e-49ef-a4b9-f4ed713039f6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:31.884100 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-da6f1709-d04e-49ef-a4b9-f4ed713039f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:31.977220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 141/275] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:32.011253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136294d8-ca94-4b0e-bf7c-ebc8ead2a754 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.131446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136294d8-ca94-4b0e-bf7c-ebc8ead2a754 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:32.168937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64366dd-ca37-4740-bfcf-1424c257052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:32.169927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64366dd-ca37-4740-bfcf-1424c257052e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.170407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64366dd-ca37-4740-bfcf-1424c257052e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.170871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64366dd-ca37-4740-bfcf-1424c257052e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.181876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64366dd-ca37-4740-bfcf-1424c257052e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f64366dd-ca37-4740-bfcf-1424c257052e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:32.187109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:32.187957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:32.188765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:32.190966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 135/276] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:32.197915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1709-d04e-49ef-a4b9-f4ed713039f6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.247154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64366dd-ca37-4740-bfcf-1424c257052e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.291017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:32.319490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:32.346631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1709-d04e-49ef-a4b9-f4ed713039f6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:32.379914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64366dd-ca37-4740-bfcf-1424c257052e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:32.384975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:32.385820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.386326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.386790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.387637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:32.388130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:32.389762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:32.399973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 142/277] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:32.401214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.419723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbdffb-9187-45f5-ae1a-5fcc3dab7003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:32.420749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbdffb-9187-45f5-ae1a-5fcc3dab7003 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.421344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbdffb-9187-45f5-ae1a-5fcc3dab7003 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.421625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbdffb-9187-45f5-ae1a-5fcc3dab7003 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.422894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbdffb-9187-45f5-ae1a-5fcc3dab7003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:32.424690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbdffb-9187-45f5-ae1a-5fcc3dab7003 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:32.426716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 136/278] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:32.427484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbdffb-9187-45f5-ae1a-5fcc3dab7003 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.515500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6e19-e283-4f88-802f-c5ee55fa6b38 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:32.539857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:32.541434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbdffb-9187-45f5-ae1a-5fcc3dab7003 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:32.551963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb36d3-cdad-4328-85b0-572e9a6126fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:32.552638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb36d3-cdad-4328-85b0-572e9a6126fe None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.552982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb36d3-cdad-4328-85b0-572e9a6126fe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.554078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb36d3-cdad-4328-85b0-572e9a6126fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.567773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb36d3-cdad-4328-85b0-572e9a6126fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:32.571584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-33bb36d3-cdad-4328-85b0-572e9a6126fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:32.574226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:32.575118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:32.576030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 143/279] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:32.577466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb36d3-cdad-4328-85b0-572e9a6126fe None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.587270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318bec6-d87d-4b24-9eb4-c3c3a6d5b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:32.587945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bec6-d87d-4b24-9eb4-c3c3a6d5b542 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.588229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bec6-d87d-4b24-9eb4-c3c3a6d5b542 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.588529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bec6-d87d-4b24-9eb4-c3c3a6d5b542 None admin] PATH_INFO: `/v3/users/79b59aca40b14aaab15cf599c5f89334` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.604786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318bec6-d87d-4b24-9eb4-c3c3a6d5b542 None admin] RBAC: Authorizing `identity:get_user(user_id=79b59aca40b14aaab15cf599c5f89334)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:32.606273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318bec6-d87d-4b24-9eb4-c3c3a6d5b542 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:32.608137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 137/280] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:32 2022] GET /identity/v3/users/79b59aca40b14aaab15cf599c5f89334 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:32.609357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318bec6-d87d-4b24-9eb4-c3c3a6d5b542 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.698155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb36d3-cdad-4328-85b0-572e9a6126fe None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:32.731424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318bec6-d87d-4b24-9eb4-c3c3a6d5b542 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:32.742317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b9967-8822-4902-97e7-c5117189f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:32.743247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b9967-8822-4902-97e7-c5117189f3ae None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.743797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b9967-8822-4902-97e7-c5117189f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.744079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b9967-8822-4902-97e7-c5117189f3ae None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.744755 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b9967-8822-4902-97e7-c5117189f3ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:32.746197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b9967-8822-4902-97e7-c5117189f3ae None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:32.769544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:32.770186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.770866 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.771423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:32.772296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:32.775577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:32.784177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 138/281] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:32.785076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.829597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:32.877252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 144/282] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:49:32 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:32.878467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b9967-8822-4902-97e7-c5117189f3ae None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:32.888333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7ad59-4ec6-468b-8bcf-dca3cc38c14c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:32.940849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831d9ae-40ee-45c8-b53f-8816f711b710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:32.941826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d9ae-40ee-45c8-b53f-8816f711b710 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.942306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d9ae-40ee-45c8-b53f-8816f711b710 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.942776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d9ae-40ee-45c8-b53f-8816f711b710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.944174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831d9ae-40ee-45c8-b53f-8816f711b710 None admin] RBAC: Adding query filter params (role.id=943b210730ce4efdaa3903233fba5962, user.id=79b59aca40b14aaab15cf599c5f89334, scope.system=all) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:32.947022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831d9ae-40ee-45c8-b53f-8816f711b710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:32.947196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831d9ae-40ee-45c8-b53f-8816f711b710 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:32.949228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:32.963036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 139/283] 10.222.0.75 () {56 vars in 1308 bytes} [Mon Sep 19 14:49:32 2022] GET /identity/v3/role_assignments?user.id=79b59aca40b14aaab15cf599c5f89334&scope.system=all&role.id=943b210730ce4efdaa3903233fba5962 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:32.963036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b428-e7ae-44a4-9b40-61ab4e0303f2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.963036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b428-e7ae-44a4-9b40-61ab4e0303f2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.963036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b428-e7ae-44a4-9b40-61ab4e0303f2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.963036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 140/284] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:32.965405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b039f-4196-4b05-ac23-ea9946843393 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:32.965771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b039f-4196-4b05-ac23-ea9946843393 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:32.966128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b039f-4196-4b05-ac23-ea9946843393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:32.988931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-840b039f-4196-4b05-ac23-ea9946843393 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:32.990201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-840b039f-4196-4b05-ac23-ea9946843393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:33.046928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b9967-8822-4902-97e7-c5117189f3ae None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:33.096821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 141/285] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:33.100420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466bd19-0958-4867-9e21-9f0ecb692d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:33.101129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466bd19-0958-4867-9e21-9f0ecb692d5a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:33.101458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466bd19-0958-4867-9e21-9f0ecb692d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:33.101733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466bd19-0958-4867-9e21-9f0ecb692d5a None admin] PATH_INFO: `/v3/users/166c862e7c104d15a00e5d590d0c1b66` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:33.102906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466bd19-0958-4867-9e21-9f0ecb692d5a None admin] RBAC: Authorizing `identity:get_user(user_id=166c862e7c104d15a00e5d590d0c1b66)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:33.104356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466bd19-0958-4867-9e21-9f0ecb692d5a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:33.106089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 145/286] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:32 2022] GET /identity/v3/users/166c862e7c104d15a00e5d590d0c1b66 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:33.112606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b039f-4196-4b05-ac23-ea9946843393 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:33.154685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:33.229269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b039f-4196-4b05-ac23-ea9946843393 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:33.269618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8ca6-7a7a-4dc9-aa4d-8502ef12b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:33.270357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8ca6-7a7a-4dc9-aa4d-8502ef12b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:33.270638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8ca6-7a7a-4dc9-aa4d-8502ef12b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:33.270919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8ca6-7a7a-4dc9-aa4d-8502ef12b0e4 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:33.272786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba8ca6-7a7a-4dc9-aa4d-8502ef12b0e4 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:33.274237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba8ca6-7a7a-4dc9-aa4d-8502ef12b0e4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:33.276195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 142/287] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:33 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:33.282505 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466bd19-0958-4867-9e21-9f0ecb692d5a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:33.387371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8ca6-7a7a-4dc9-aa4d-8502ef12b0e4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:33.439156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466bd19-0958-4867-9e21-9f0ecb692d5a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:33.447607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:33.483241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4f25d-f7b9-41d3-a19d-acc46a2ab93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:33.483853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4f25d-f7b9-41d3-a19d-acc46a2ab93e None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:33.484132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4f25d-f7b9-41d3-a19d-acc46a2ab93e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:33.484412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4f25d-f7b9-41d3-a19d-acc46a2ab93e None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d/users/166c862e7c104d15a00e5d590d0c1b66/roles/ca153d9f3fae4e60b97c36c60d357c55` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:33.486841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4f25d-f7b9-41d3-a19d-acc46a2ab93e None admin] RBAC: Authorizing `identity:create_grant(project_id=165361dc47704cb28d965f63da95703d, user_id=166c862e7c104d15a00e5d590d0c1b66, role_id=ca153d9f3fae4e60b97c36c60d357c55)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:33.489059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4f25d-f7b9-41d3-a19d-acc46a2ab93e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:33.514369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8ca6-7a7a-4dc9-aa4d-8502ef12b0e4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:33.517246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:33.553903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642302-a26e-4ab3-a305-ff0bddb2937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:33.554899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642302-a26e-4ab3-a305-ff0bddb2937f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:33.555348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642302-a26e-4ab3-a305-ff0bddb2937f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:33.555821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642302-a26e-4ab3-a305-ff0bddb2937f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:33.567133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1642302-a26e-4ab3-a305-ff0bddb2937f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f1642302-a26e-4ab3-a305-ff0bddb2937f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:33.573273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:33.574150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:33.574966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:33.582392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 143/288] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:33.583822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642302-a26e-4ab3-a305-ff0bddb2937f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:33.625880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 146/289] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:49:33 2022] PUT /identity/v3/projects/165361dc47704cb28d965f63da95703d/users/166c862e7c104d15a00e5d590d0c1b66/roles/ca153d9f3fae4e60b97c36c60d357c55 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:33.706649 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642302-a26e-4ab3-a305-ff0bddb2937f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:33.746489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:33.747042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:33.747328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:33.747602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:33.750528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:33.750528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:33.750528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:33.764624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 144/290] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:33.766885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4f25d-f7b9-41d3-a19d-acc46a2ab93e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:33.896372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4f25d-f7b9-41d3-a19d-acc46a2ab93e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:33.933413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ffdb-b239-4ce2-9e07-e0583f32c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:33.934072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ffdb-b239-4ce2-9e07-e0583f32c30c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:33.934335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ffdb-b239-4ce2-9e07-e0583f32c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:33.934606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ffdb-b239-4ce2-9e07-e0583f32c30c None admin] PATH_INFO: `/v3/users/1b80fba4f3d4424dac70bdeffc904a4a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:33.935736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ffdb-b239-4ce2-9e07-e0583f32c30c None admin] RBAC: Authorizing `identity:get_user(user_id=1b80fba4f3d4424dac70bdeffc904a4a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:33.937192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ffdb-b239-4ce2-9e07-e0583f32c30c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:33.938962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 147/291] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:33 2022] GET /identity/v3/users/1b80fba4f3d4424dac70bdeffc904a4a => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:33.945477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:33.981045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:34.070845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a492aa-57bd-492a-9312-97e71df78e91 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:34.108982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba9d73-f4c6-472f-837c-c66b22bccc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:34.109973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba9d73-f4c6-472f-837c-c66b22bccc89 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:34.110466 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba9d73-f4c6-472f-837c-c66b22bccc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:34.110957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba9d73-f4c6-472f-837c-c66b22bccc89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:34.198458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba9d73-f4c6-472f-837c-c66b22bccc89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:34.200367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba9d73-f4c6-472f-837c-c66b22bccc89 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:34.228428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:34.311424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 145/292] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:34.312815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ffdb-b239-4ce2-9e07-e0583f32c30c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:34.364970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:34.473071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ffdb-b239-4ce2-9e07-e0583f32c30c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:34.526530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bd3d6-7f3c-4330-9a5d-f2d6d2976c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:34.527175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd3d6-7f3c-4330-9a5d-f2d6d2976c5c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:34.527455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd3d6-7f3c-4330-9a5d-f2d6d2976c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:34.527728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd3d6-7f3c-4330-9a5d-f2d6d2976c5c None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:34.528887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bd3d6-7f3c-4330-9a5d-f2d6d2976c5c None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:34.530312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bd3d6-7f3c-4330-9a5d-f2d6d2976c5c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:34.532248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 148/293] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:34 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:34.538880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba9d73-f4c6-472f-837c-c66b22bccc89 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:34.656638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba9d73-f4c6-472f-837c-c66b22bccc89 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:34.684884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:34.692729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566a3b8-f3f3-40ff-bbcb-01adc7746806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:34.693398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a3b8-f3f3-40ff-bbcb-01adc7746806 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:34.694275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a3b8-f3f3-40ff-bbcb-01adc7746806 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:34.694776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a3b8-f3f3-40ff-bbcb-01adc7746806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:34.698838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566a3b8-f3f3-40ff-bbcb-01adc7746806 None admin] RBAC: Adding query filter params (role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=165361dc47704cb28d965f63da95703d, user.id=1b80fba4f3d4424dac70bdeffc904a4a) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:34.698838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566a3b8-f3f3-40ff-bbcb-01adc7746806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:34.698838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566a3b8-f3f3-40ff-bbcb-01adc7746806 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:34.708603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 146/294] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:34 2022] GET /identity/v3/role_assignments?user.id=1b80fba4f3d4424dac70bdeffc904a4a&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=943b210730ce4efdaa3903233fba5962 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:35.553468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0353d6-b9c0-41d8-b8f3-eb2549dc43a6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:35.553988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0353d6-b9c0-41d8-b8f3-eb2549dc43a6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:35.553988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0353d6-b9c0-41d8-b8f3-eb2549dc43a6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:35.555710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 149/295] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:35.561452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd1a1-85f1-44a9-9fdc-d8d5924b4be9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:35.561981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd1a1-85f1-44a9-9fdc-d8d5924b4be9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:35.561981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd1a1-85f1-44a9-9fdc-d8d5924b4be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:35.581419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1a4bd1a1-85f1-44a9-9fdc-d8d5924b4be9 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:35.582605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1a4bd1a1-85f1-44a9-9fdc-d8d5924b4be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:35.651725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 147/296] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:35.671004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e797d75-c5a9-4ad4-80b9-f8ae3f42338e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:35.671604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e797d75-c5a9-4ad4-80b9-f8ae3f42338e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:35.672070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e797d75-c5a9-4ad4-80b9-f8ae3f42338e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:35.673913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 150/297] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:35.680674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34a191-b4bb-4890-8f5b-59a9333d3faf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:35.681268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34a191-b4bb-4890-8f5b-59a9333d3faf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:35.681769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34a191-b4bb-4890-8f5b-59a9333d3faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:35.701450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1d34a191-b4bb-4890-8f5b-59a9333d3faf None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:35.703032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1d34a191-b4bb-4890-8f5b-59a9333d3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:35.782093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 148/298] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:35.925585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e797d75-c5a9-4ad4-80b9-f8ae3f42338e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:35.957284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d46c-e752-4262-8f99-42961adf8b1b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:35.957991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d46c-e752-4262-8f99-42961adf8b1b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:35.958626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d46c-e752-4262-8f99-42961adf8b1b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:35.961826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 149/299] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:35.967708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01141-314f-4cae-9d01-8fb467d740e3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:35.967996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01141-314f-4cae-9d01-8fb467d740e3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:35.968272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01141-314f-4cae-9d01-8fb467d740e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:35.988885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7cd01141-314f-4cae-9d01-8fb467d740e3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:35.990086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7cd01141-314f-4cae-9d01-8fb467d740e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:36.040665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:36.049265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e797d75-c5a9-4ad4-80b9-f8ae3f42338e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.051267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:36.061994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 150/300] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:36.088868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd01141-314f-4cae-9d01-8fb467d740e3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.089663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6defa-7a94-4260-b003-cc31653d3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.090375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6defa-7a94-4260-b003-cc31653d3659 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.090662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6defa-7a94-4260-b003-cc31653d3659 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.090938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6defa-7a94-4260-b003-cc31653d3659 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.105463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6defa-7a94-4260-b003-cc31653d3659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-17b6defa-7a94-4260-b003-cc31653d3659 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:36.111988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:36.112904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:36.114019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 151/301] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:36.119380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6defa-7a94-4260-b003-cc31653d3659 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.213277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd01141-314f-4cae-9d01-8fb467d740e3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.251975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510798ee-55d8-47e5-8027-521e261e2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.252655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510798ee-55d8-47e5-8027-521e261e2638 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.252993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510798ee-55d8-47e5-8027-521e261e2638 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.253272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510798ee-55d8-47e5-8027-521e261e2638 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.263049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6defa-7a94-4260-b003-cc31653d3659 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.265132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510798ee-55d8-47e5-8027-521e261e2638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-510798ee-55d8-47e5-8027-521e261e2638 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:36.270332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:36.271239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:36.273091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 151/302] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:49:36.281428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510798ee-55d8-47e5-8027-521e261e2638 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.309905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5487456-58ef-43e4-801c-cb9ed4b2a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.310518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5487456-58ef-43e4-801c-cb9ed4b2a40b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.310806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5487456-58ef-43e4-801c-cb9ed4b2a40b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.311081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5487456-58ef-43e4-801c-cb9ed4b2a40b None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.311750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5487456-58ef-43e4-801c-cb9ed4b2a40b None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:36.312050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5487456-58ef-43e4-801c-cb9ed4b2a40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:36.313452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5487456-58ef-43e4-801c-cb9ed4b2a40b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:36.323086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 152/303] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:36.324398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46221-2587-4201-8e94-2d9465f10490 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.324579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46221-2587-4201-8e94-2d9465f10490 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.324861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46221-2587-4201-8e94-2d9465f10490 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.328884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 153/304] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:36.328884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46221-2587-4201-8e94-2d9465f10490 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.330575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:36.358195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:36.394345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510798ee-55d8-47e5-8027-521e261e2638 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.431537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f42f76-c722-402a-bf85-09575febeb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.432143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f42f76-c722-402a-bf85-09575febeb14 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.432425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f42f76-c722-402a-bf85-09575febeb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.432732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f42f76-c722-402a-bf85-09575febeb14 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.433790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f42f76-c722-402a-bf85-09575febeb14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:36.434298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f42f76-c722-402a-bf85-09575febeb14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:36.436694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f42f76-c722-402a-bf85-09575febeb14 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:36.455023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 152/305] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:36.455023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ca68-8860-4a9e-aa10-895c7c29e851 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.455023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ca68-8860-4a9e-aa10-895c7c29e851 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.455023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ca68-8860-4a9e-aa10-895c7c29e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.455386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46221-2587-4201-8e94-2d9465f10490 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.478956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d3c3ca68-8860-4a9e-aa10-895c7c29e851 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:36.480777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d3c3ca68-8860-4a9e-aa10-895c7c29e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:36.502131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a704b-172e-45c4-a357-f279ecef482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.502773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a704b-172e-45c4-a357-f279ecef482a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.503051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a704b-172e-45c4-a357-f279ecef482a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.503326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a704b-172e-45c4-a357-f279ecef482a None admin] PATH_INFO: `/v3/users/79b59aca40b14aaab15cf599c5f89334` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.504434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a704b-172e-45c4-a357-f279ecef482a None admin] RBAC: Authorizing `identity:get_user(user_id=79b59aca40b14aaab15cf599c5f89334)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:36.505900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a704b-172e-45c4-a357-f279ecef482a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:36.508040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 154/306] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:36 2022] GET /identity/v3/users/79b59aca40b14aaab15cf599c5f89334 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:36.512173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a704b-172e-45c4-a357-f279ecef482a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.554593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 153/307] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:36.555448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3ca68-8860-4a9e-aa10-895c7c29e851 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.592933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:36.617768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:36.628254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a704b-172e-45c4-a357-f279ecef482a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.665611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0b53f-4faa-42a0-8aab-8aa1dab03359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.666237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b53f-4faa-42a0-8aab-8aa1dab03359 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.666522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b53f-4faa-42a0-8aab-8aa1dab03359 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.666689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3ca68-8860-4a9e-aa10-895c7c29e851 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.666790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b53f-4faa-42a0-8aab-8aa1dab03359 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.667898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0b53f-4faa-42a0-8aab-8aa1dab03359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:36.669382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0b53f-4faa-42a0-8aab-8aa1dab03359 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:36.670943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 155/308] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:36.671688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0b53f-4faa-42a0-8aab-8aa1dab03359 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.704746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feffb72-6b7f-40c1-a280-4d40440aea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.705382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffb72-6b7f-40c1-a280-4d40440aea27 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.705662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffb72-6b7f-40c1-a280-4d40440aea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.705933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffb72-6b7f-40c1-a280-4d40440aea27 None admin] PATH_INFO: `/v3/users/7a07a1884143470cbcacf8b5ef1f759e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.721956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feffb72-6b7f-40c1-a280-4d40440aea27 None admin] RBAC: Authorizing `identity:get_user(user_id=7a07a1884143470cbcacf8b5ef1f759e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:36.724780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feffb72-6b7f-40c1-a280-4d40440aea27 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:36.732038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 154/309] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:36 2022] GET /identity/v3/users/7a07a1884143470cbcacf8b5ef1f759e => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:36.732038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feffb72-6b7f-40c1-a280-4d40440aea27 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.801979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0b53f-4faa-42a0-8aab-8aa1dab03359 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.838492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81db13-6d07-4c9f-927f-72a70d38b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.839154 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81db13-6d07-4c9f-927f-72a70d38b190 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.839434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81db13-6d07-4c9f-927f-72a70d38b190 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.839713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81db13-6d07-4c9f-927f-72a70d38b190 None admin] PATH_INFO: `/v3/system/users/79b59aca40b14aaab15cf599c5f89334/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.841178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81db13-6d07-4c9f-927f-72a70d38b190 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=79b59aca40b14aaab15cf599c5f89334, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:36.842537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81db13-6d07-4c9f-927f-72a70d38b190 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:36.844064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:36.853711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feffb72-6b7f-40c1-a280-4d40440aea27 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:36.886336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03adb1-dba1-482c-b74e-d4d8161ebba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:36.886933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03adb1-dba1-482c-b74e-d4d8161ebba1 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:36.887208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03adb1-dba1-482c-b74e-d4d8161ebba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:36.887476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03adb1-dba1-482c-b74e-d4d8161ebba1 None admin] PATH_INFO: `/v3/groups` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:36.888096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03adb1-dba1-482c-b74e-d4d8161ebba1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:36.889618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03adb1-dba1-482c-b74e-d4d8161ebba1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:36.930542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 156/310] 10.222.0.75 () {58 vars in 1334 bytes} [Mon Sep 19 14:49:36 2022] PUT /identity/v3/system/users/79b59aca40b14aaab15cf599c5f89334/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:36.931425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81db13-6d07-4c9f-927f-72a70d38b190 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:36.960745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:37.016069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 155/311] 10.222.0.75 () {60 vars in 1134 bytes} [Mon Sep 19 14:49:36 2022] POST /identity/v3/groups => generated 229 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:37.017027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03adb1-dba1-482c-b74e-d4d8161ebba1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:37.067424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81db13-6d07-4c9f-927f-72a70d38b190 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:37.119956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:37.122070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.122356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.122631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.123382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] RBAC: Adding query filter params (role.id=ca153d9f3fae4e60b97c36c60d357c55, user.id=7a07a1884143470cbcacf8b5ef1f759e, scope.system=all) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:37.123700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:37.127032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:37.132240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 157/312] 10.222.0.75 () {56 vars in 1308 bytes} [Mon Sep 19 14:49:36 2022] GET /identity/v3/role_assignments?user.id=7a07a1884143470cbcacf8b5ef1f759e&scope.system=all&role.id=ca153d9f3fae4e60b97c36c60d357c55 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:37.166672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03adb1-dba1-482c-b74e-d4d8161ebba1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:37.213121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ace1e-9132-438e-a273-e240d3d1d7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:37.214052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ace1e-9132-438e-a273-e240d3d1d7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.214525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ace1e-9132-438e-a273-e240d3d1d7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.214965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ace1e-9132-438e-a273-e240d3d1d7b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.228453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ace1e-9132-438e-a273-e240d3d1d7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6a4ace1e-9132-438e-a273-e240d3d1d7b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:37.234523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:37.235675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:37.236543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:37.237590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 156/313] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:37.245468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:37.347355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:37.363503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb64e-9865-4d3f-a451-f1abe144e638 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:37.399815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:37.400434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.400749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.401028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.401702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:37.402010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:37.403441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:37.413449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 158/314] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:37.418869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ace1e-9132-438e-a273-e240d3d1d7b0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:37.434350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:37.529540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ace1e-9132-438e-a273-e240d3d1d7b0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:37.569578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427880e9-b9ab-4459-b35c-343635168f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:37.570550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427880e9-b9ab-4459-b35c-343635168f3a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.571623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427880e9-b9ab-4459-b35c-343635168f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.572000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427880e9-b9ab-4459-b35c-343635168f3a None admin] PATH_INFO: `/v3/users/166c862e7c104d15a00e5d590d0c1b66` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.573250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427880e9-b9ab-4459-b35c-343635168f3a None admin] RBAC: Authorizing `identity:get_user(user_id=166c862e7c104d15a00e5d590d0c1b66)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:37.574767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427880e9-b9ab-4459-b35c-343635168f3a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:37.576778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 157/315] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:37 2022] GET /identity/v3/users/166c862e7c104d15a00e5d590d0c1b66 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:37.582276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:37.692983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f23614-6dc6-487e-b27a-f8d2da535f38 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:37.739637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2dbe1-ab26-4987-a52a-f31140431f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:37.741158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2dbe1-ab26-4987-a52a-f31140431f65 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.741659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2dbe1-ab26-4987-a52a-f31140431f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.742189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2dbe1-ab26-4987-a52a-f31140431f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.762694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:37.817532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2dbe1-ab26-4987-a52a-f31140431f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:37.819107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2dbe1-ab26-4987-a52a-f31140431f65 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:37.979533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 159/316] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:37.989603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427880e9-b9ab-4459-b35c-343635168f3a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:38.076308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:38.102114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427880e9-b9ab-4459-b35c-343635168f3a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:38.143791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530a6c3-f74e-4ed9-abe0-9b3006173d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:38.144857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a6c3-f74e-4ed9-abe0-9b3006173d34 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:38.145336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a6c3-f74e-4ed9-abe0-9b3006173d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:38.145800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a6c3-f74e-4ed9-abe0-9b3006173d34 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:38.147901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530a6c3-f74e-4ed9-abe0-9b3006173d34 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:38.149607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530a6c3-f74e-4ed9-abe0-9b3006173d34 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:38.151874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 158/317] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:37 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:38.157494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2dbe1-ab26-4987-a52a-f31140431f65 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:38.218481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:38.279996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2dbe1-ab26-4987-a52a-f31140431f65 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:38.320891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64d6b4-a8c4-4c6d-9e41-ed931f8561c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:38.321515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d6b4-a8c4-4c6d-9e41-ed931f8561c2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:38.321804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d6b4-a8c4-4c6d-9e41-ed931f8561c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:38.322076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d6b4-a8c4-4c6d-9e41-ed931f8561c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:38.322814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64d6b4-a8c4-4c6d-9e41-ed931f8561c2 None admin] RBAC: Adding query filter params (role.id=ca153d9f3fae4e60b97c36c60d357c55, scope.project.id=165361dc47704cb28d965f63da95703d, user.id=166c862e7c104d15a00e5d590d0c1b66) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:38.323124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64d6b4-a8c4-4c6d-9e41-ed931f8561c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:38.326133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64d6b4-a8c4-4c6d-9e41-ed931f8561c2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:38.335719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 160/318] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:49:38 2022] GET /identity/v3/role_assignments?user.id=166c862e7c104d15a00e5d590d0c1b66&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=ca153d9f3fae4e60b97c36c60d357c55 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:39.306408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74395-1eae-4734-a9d0-c2e86b9b74a7 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:39.306942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74395-1eae-4734-a9d0-c2e86b9b74a7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:39.306942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74395-1eae-4734-a9d0-c2e86b9b74a7 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:39.308437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 159/319] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:39.313400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63c6b-36b3-4fcf-8e4b-98d96aae75cc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:39.313779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63c6b-36b3-4fcf-8e4b-98d96aae75cc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:39.313944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63c6b-36b3-4fcf-8e4b-98d96aae75cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:39.332735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e9b63c6b-36b3-4fcf-8e4b-98d96aae75cc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:39.333759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e9b63c6b-36b3-4fcf-8e4b-98d96aae75cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:39.412069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 161/320] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:39.486497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864f3d3-8f68-474f-aa69-837669885ba8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:39.486794 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864f3d3-8f68-474f-aa69-837669885ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:39.487050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864f3d3-8f68-474f-aa69-837669885ba8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:39.488525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 160/321] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:39.494325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f4851-aae9-4ee4-bd62-1249f405bc2b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:39.494615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f4851-aae9-4ee4-bd62-1249f405bc2b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:39.494886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f4851-aae9-4ee4-bd62-1249f405bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:39.513794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-538f4851-aae9-4ee4-bd62-1249f405bc2b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:39.521446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-538f4851-aae9-4ee4-bd62-1249f405bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:39.559922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:39.590058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 162/322] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:39.649516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471f1e-56f6-4cf9-8c0c-f0bfe61e1a55 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:39.649856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471f1e-56f6-4cf9-8c0c-f0bfe61e1a55 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:39.650080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8471f1e-56f6-4cf9-8c0c-f0bfe61e1a55 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:39.651542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 161/323] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:39.656546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6170e-ac71-4526-b322-a5e922ea0c38 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:39.656868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6170e-ac71-4526-b322-a5e922ea0c38 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:39.657116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6170e-ac71-4526-b322-a5e922ea0c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:39.675165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6ed6170e-ac71-4526-b322-a5e922ea0c38 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:39.676365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6ed6170e-ac71-4526-b322-a5e922ea0c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:39.681361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8471f1e-56f6-4cf9-8c0c-f0bfe61e1a55 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:39.763103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 163/324] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:39.807415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8471f1e-56f6-4cf9-8c0c-f0bfe61e1a55 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:39.842639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509371d5-a1ca-436e-9165-abc429afbe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:39.843272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509371d5-a1ca-436e-9165-abc429afbe74 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:39.843556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509371d5-a1ca-436e-9165-abc429afbe74 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:39.843859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509371d5-a1ca-436e-9165-abc429afbe74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:39.855105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509371d5-a1ca-436e-9165-abc429afbe74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-509371d5-a1ca-436e-9165-abc429afbe74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:39.860001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:39.861052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:39.861886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:39.864806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 162/325] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:49:39.867415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6170e-ac71-4526-b322-a5e922ea0c38 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:39.868748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509371d5-a1ca-436e-9165-abc429afbe74 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:39.879516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:39.970981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6170e-ac71-4526-b322-a5e922ea0c38 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:39.973758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:39.979785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509371d5-a1ca-436e-9165-abc429afbe74 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.010550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.011163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.011440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.011709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.012363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:40.012683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:40.014047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:40.014300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d6b99-2d9c-4509-ad96-3e8bce14b361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.014934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d6b99-2d9c-4509-ad96-3e8bce14b361 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.015216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d6b99-2d9c-4509-ad96-3e8bce14b361 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.015494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d6b99-2d9c-4509-ad96-3e8bce14b361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.016660 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d6b99-2d9c-4509-ad96-3e8bce14b361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:40.018093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d6b99-2d9c-4509-ad96-3e8bce14b361 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:40.019830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 163/326] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:49:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:40.023597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 164/327] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:40.028924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:40.029145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d6b99-2d9c-4509-ad96-3e8bce14b361 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:40.104257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:40.129567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d6b99-2d9c-4509-ad96-3e8bce14b361 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.130168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb61c8-cad8-416b-8f4a-1388f40b0cf9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.167190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5b18-bff0-4b55-ad38-44d573eab190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.167797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5b18-bff0-4b55-ad38-44d573eab190 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.168077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5b18-bff0-4b55-ad38-44d573eab190 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.168350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5b18-bff0-4b55-ad38-44d573eab190 None admin] PATH_INFO: `/v3/groups` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.169028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5b18-bff0-4b55-ad38-44d573eab190 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:40.169389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9e3cb-e70c-44a6-aa63-0c95b059f11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.170017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9e3cb-e70c-44a6-aa63-0c95b059f11f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.170296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9e3cb-e70c-44a6-aa63-0c95b059f11f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.170447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5b18-bff0-4b55-ad38-44d573eab190 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:40.170568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9e3cb-e70c-44a6-aa63-0c95b059f11f None admin] PATH_INFO: `/v3/users/79b59aca40b14aaab15cf599c5f89334` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.171679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9e3cb-e70c-44a6-aa63-0c95b059f11f None admin] RBAC: Authorizing `identity:get_user(user_id=79b59aca40b14aaab15cf599c5f89334)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:40.173146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9e3cb-e70c-44a6-aa63-0c95b059f11f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:40.174695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 164/328] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:40 2022] GET /identity/v3/users/79b59aca40b14aaab15cf599c5f89334 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:40.175447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9e3cb-e70c-44a6-aa63-0c95b059f11f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:40.288506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9e3cb-e70c-44a6-aa63-0c95b059f11f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.321284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d2b8-38cd-4d79-b0d8-c7b4b251caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.321910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d2b8-38cd-4d79-b0d8-c7b4b251caaf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.322174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d2b8-38cd-4d79-b0d8-c7b4b251caaf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.322449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d2b8-38cd-4d79-b0d8-c7b4b251caaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.329549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 165/329] 10.222.0.75 () {60 vars in 1134 bytes} [Mon Sep 19 14:49:40 2022] POST /identity/v3/groups => generated 226 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:49:40.330436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5b18-bff0-4b55-ad38-44d573eab190 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:40.344056 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834d2b8-38cd-4d79-b0d8-c7b4b251caaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5834d2b8-38cd-4d79-b0d8-c7b4b251caaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:40.350470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:40.351670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:40.352627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 165/330] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:40.357895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d2b8-38cd-4d79-b0d8-c7b4b251caaf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:40.363872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:40.368545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:40.449204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5b18-bff0-4b55-ad38-44d573eab190 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.476668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d2b8-38cd-4d79-b0d8-c7b4b251caaf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.488590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.489291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.489782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.490060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.491132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] RBAC: Adding query filter params (role.id=943b210730ce4efdaa3903233fba5962, user.id=79b59aca40b14aaab15cf599c5f89334, scope.system=all) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:40.491538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:40.493036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:40.507320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 166/331] 10.222.0.75 () {56 vars in 1308 bytes} [Mon Sep 19 14:49:40 2022] GET /identity/v3/role_assignments?user.id=79b59aca40b14aaab15cf599c5f89334&scope.system=all&role.id=943b210730ce4efdaa3903233fba5962 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:40.521314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.522501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.522784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.523062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.523774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:40.524057 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:40.525622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:40.536914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 166/332] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:40.544067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:40.641514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:40.659683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f0618-f6d8-4eec-a58f-6aeef534e3c0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.699871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0444f-ebcd-419b-a686-0b552929120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.700569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0444f-ebcd-419b-a686-0b552929120f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.700856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0444f-ebcd-419b-a686-0b552929120f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.701135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0444f-ebcd-419b-a686-0b552929120f None admin] PATH_INFO: `/v3/users/7a07a1884143470cbcacf8b5ef1f759e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.702279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0444f-ebcd-419b-a686-0b552929120f None admin] RBAC: Authorizing `identity:get_user(user_id=7a07a1884143470cbcacf8b5ef1f759e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:40.703770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0444f-ebcd-419b-a686-0b552929120f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:40.705773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 167/333] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:40 2022] GET /identity/v3/users/7a07a1884143470cbcacf8b5ef1f759e => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:40.712958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:40.794619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:40.836174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9ab1-b3ec-4402-a7ff-30dfe08b2bd2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.873131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6812ee-ea55-4d82-9998-404ed821f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:40.873793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6812ee-ea55-4d82-9998-404ed821f4f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.874069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6812ee-ea55-4d82-9998-404ed821f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.874345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6812ee-ea55-4d82-9998-404ed821f4f2 None admin] PATH_INFO: `/v3/system/users/7a07a1884143470cbcacf8b5ef1f759e/roles/ca153d9f3fae4e60b97c36c60d357c55` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.875755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6812ee-ea55-4d82-9998-404ed821f4f2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a07a1884143470cbcacf8b5ef1f759e, role_id=ca153d9f3fae4e60b97c36c60d357c55)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:40.877267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6812ee-ea55-4d82-9998-404ed821f4f2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:41.028437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 167/334] 10.222.0.75 () {58 vars in 1334 bytes} [Mon Sep 19 14:49:40 2022] PUT /identity/v3/system/users/7a07a1884143470cbcacf8b5ef1f759e/roles/ca153d9f3fae4e60b97c36c60d357c55 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:43.072406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8cc12-0873-49b0-b1dc-02d40fc1d644 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:43.072941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8cc12-0873-49b0-b1dc-02d40fc1d644 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:43.073017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8cc12-0873-49b0-b1dc-02d40fc1d644 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:43.074599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 168/335] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:43.080000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282852b-cfe7-4323-af22-70f59769ea8f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:43.080443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282852b-cfe7-4323-af22-70f59769ea8f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:43.080659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282852b-cfe7-4323-af22-70f59769ea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:43.104894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8282852b-cfe7-4323-af22-70f59769ea8f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:43.106085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8282852b-cfe7-4323-af22-70f59769ea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:43.198801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 168/336] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:43.765984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8cc12-0873-49b0-b1dc-02d40fc1d644 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:43.817154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a4eb-ac84-4e72-be38-ab75ebee7ff8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:43.817777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a4eb-ac84-4e72-be38-ab75ebee7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:43.818793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a4eb-ac84-4e72-be38-ab75ebee7ff8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:43.821918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 169/337] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:43.826019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de343e3-a59a-4e7b-8931-bc099c1f3d12 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:43.826548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de343e3-a59a-4e7b-8931-bc099c1f3d12 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:43.827024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de343e3-a59a-4e7b-8931-bc099c1f3d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:43.870580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7de343e3-a59a-4e7b-8931-bc099c1f3d12 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:43.871798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7de343e3-a59a-4e7b-8931-bc099c1f3d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:43.924586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8cc12-0873-49b0-b1dc-02d40fc1d644 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:43.993435 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:43.999364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8af16-f6a8-490e-81e8-b80d03d127dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:44.000053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8af16-f6a8-490e-81e8-b80d03d127dc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.000279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8af16-f6a8-490e-81e8-b80d03d127dc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.000595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8af16-f6a8-490e-81e8-b80d03d127dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.026345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 170/338] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:44.027962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be80e-6d87-4dff-bb92-05ff10ffea8e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.028242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be80e-6d87-4dff-bb92-05ff10ffea8e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.029299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8af16-f6a8-490e-81e8-b80d03d127dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:44.032999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be80e-6d87-4dff-bb92-05ff10ffea8e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.034691 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 171/339] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9bb8af16-f6a8-490e-81e8-b80d03d127dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:44.036504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:44.038155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:44.039738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 169/340] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:44.044897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96275bb-c172-4ada-9067-4b8797590662 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.045168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96275bb-c172-4ada-9067-4b8797590662 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.045445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96275bb-c172-4ada-9067-4b8797590662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.049065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8af16-f6a8-490e-81e8-b80d03d127dc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:44.078243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c96275bb-c172-4ada-9067-4b8797590662 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:44.079578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c96275bb-c172-4ada-9067-4b8797590662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:44.087347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:44.185919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 172/341] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:44.250971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8af16-f6a8-490e-81e8-b80d03d127dc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:44.297118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b644c1-c914-4651-8ce9-608f18629c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:44.297653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b644c1-c914-4651-8ce9-608f18629c41 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.298063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b644c1-c914-4651-8ce9-608f18629c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.298341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b644c1-c914-4651-8ce9-608f18629c41 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.299006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b644c1-c914-4651-8ce9-608f18629c41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:44.299305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b644c1-c914-4651-8ce9-608f18629c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:44.300731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b644c1-c914-4651-8ce9-608f18629c41 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:44.310349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 170/342] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:44.316231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96275bb-c172-4ada-9067-4b8797590662 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:44.331554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72d725-3cc2-4151-b160-71f9b2ecd90c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.331852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72d725-3cc2-4151-b160-71f9b2ecd90c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.332200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72d725-3cc2-4151-b160-71f9b2ecd90c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.333578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 171/343] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:44.341162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95c075-5cfc-49f6-8275-b2091031c89c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.341442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95c075-5cfc-49f6-8275-b2091031c89c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.341714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95c075-5cfc-49f6-8275-b2091031c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.373984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2c95c075-5cfc-49f6-8275-b2091031c89c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:44.375189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2c95c075-5cfc-49f6-8275-b2091031c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:44.466278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96275bb-c172-4ada-9067-4b8797590662 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:44.478983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 172/344] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:44.480246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa9dab-e820-4e53-8957-0dc975d549e2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.480658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa9dab-e820-4e53-8957-0dc975d549e2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.480937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa9dab-e820-4e53-8957-0dc975d549e2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.483169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 173/345] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:44.484149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa9dab-e820-4e53-8957-0dc975d549e2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:44.489952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:44.494000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:44.505166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11367c75-a3e5-4560-bdfe-312481fb521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:44.509653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11367c75-a3e5-4560-bdfe-312481fb521a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.509653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11367c75-a3e5-4560-bdfe-312481fb521a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.509653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11367c75-a3e5-4560-bdfe-312481fb521a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.584930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11367c75-a3e5-4560-bdfe-312481fb521a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:44.587642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11367c75-a3e5-4560-bdfe-312481fb521a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:44.686637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa9dab-e820-4e53-8957-0dc975d549e2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:44.727699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 173/346] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:44.729723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803f3a-3994-48d8-a1bc-bdadcfaac272 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.730277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803f3a-3994-48d8-a1bc-bdadcfaac272 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.730561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803f3a-3994-48d8-a1bc-bdadcfaac272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.734724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29ebb4-df4d-41fc-b3c3-8bbdba2d56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:44.735598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ebb4-df4d-41fc-b3c3-8bbdba2d56ca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.736020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ebb4-df4d-41fc-b3c3-8bbdba2d56ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.736434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ebb4-df4d-41fc-b3c3-8bbdba2d56ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.753000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29ebb4-df4d-41fc-b3c3-8bbdba2d56ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:44.754277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-98803f3a-3994-48d8-a1bc-bdadcfaac272 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:44.755537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-98803f3a-3994-48d8-a1bc-bdadcfaac272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-2e29ebb4-df4d-41fc-b3c3-8bbdba2d56ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:44.759241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:44.760329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:44.761370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:44.768729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 174/347] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:44.769841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29ebb4-df4d-41fc-b3c3-8bbdba2d56ca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:44.770522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:44.843852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 174/348] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:44.845029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98803f3a-3994-48d8-a1bc-bdadcfaac272 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:44.866794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:44.922613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29ebb4-df4d-41fc-b3c3-8bbdba2d56ca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:44.967274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98803f3a-3994-48d8-a1bc-bdadcfaac272 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:44.973601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f7a2-2cab-41f9-9fd4-ff2f26857740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:44.974252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f7a2-2cab-41f9-9fd4-ff2f26857740 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:44.978217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f7a2-2cab-41f9-9fd4-ff2f26857740 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:44.978217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f7a2-2cab-41f9-9fd4-ff2f26857740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:44.991499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5f7a2-2cab-41f9-9fd4-ff2f26857740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8dc5f7a2-2cab-41f9-9fd4-ff2f26857740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:44.996896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:44.997863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:44.998731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:45.001372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 175/349] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:45.002465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f7a2-2cab-41f9-9fd4-ff2f26857740 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.011077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cddc75-2ade-4f6e-a32f-0b3baae364b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.011727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddc75-2ade-4f6e-a32f-0b3baae364b9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.012011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddc75-2ade-4f6e-a32f-0b3baae364b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.012285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddc75-2ade-4f6e-a32f-0b3baae364b9 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.013459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cddc75-2ade-4f6e-a32f-0b3baae364b9 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:45.015353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cddc75-2ade-4f6e-a32f-0b3baae364b9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:45.017580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 175/350] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:44 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:45.022441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cddc75-2ade-4f6e-a32f-0b3baae364b9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.046922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.169206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f7a2-2cab-41f9-9fd4-ff2f26857740 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.173502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cddc75-2ade-4f6e-a32f-0b3baae364b9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.195394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.207945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.214533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.214533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.214533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.214533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:45.214533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:45.214533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:45.216034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4739e29-d610-42fe-9b1c-e3a8452f75ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.216730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739e29-d610-42fe-9b1c-e3a8452f75ec None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.217016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739e29-d610-42fe-9b1c-e3a8452f75ec None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.217292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739e29-d610-42fe-9b1c-e3a8452f75ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.226753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 176/351] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:45.227521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.232447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4739e29-d610-42fe-9b1c-e3a8452f75ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d4739e29-d610-42fe-9b1c-e3a8452f75ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:45.237854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:45.238828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:45.239608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 176/352] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:45.241050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4739e29-d610-42fe-9b1c-e3a8452f75ec None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.346551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.368581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087de75-90bc-4fa9-aeb5-7e7181a07c2f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.374197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4739e29-d610-42fe-9b1c-e3a8452f75ec None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.410984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.411609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.411918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.412374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.413199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:45.413402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:45.414767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:45.415641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da9d8c-3f07-4c76-94ea-fc31be6e31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.416287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da9d8c-3f07-4c76-94ea-fc31be6e31d9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.416601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da9d8c-3f07-4c76-94ea-fc31be6e31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.416882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da9d8c-3f07-4c76-94ea-fc31be6e31d9 None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.425558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da9d8c-3f07-4c76-94ea-fc31be6e31d9 None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:45.426189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 177/353] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:45.426994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da9d8c-3f07-4c76-94ea-fc31be6e31d9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:45.427097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.429501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 177/354] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:45.430298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da9d8c-3f07-4c76-94ea-fc31be6e31d9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.489534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.556302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0740790-9273-4ebe-80ef-e9e3b5f9516e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.556522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da9d8c-3f07-4c76-94ea-fc31be6e31d9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.595933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d764a-b046-49c5-91d6-44cc73c80f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.596606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d764a-b046-49c5-91d6-44cc73c80f6b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.596952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d764a-b046-49c5-91d6-44cc73c80f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.597166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d764a-b046-49c5-91d6-44cc73c80f6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.602791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63a731-753e-449d-93ae-7243ae845ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.603413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a731-753e-449d-93ae-7243ae845ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.603699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a731-753e-449d-93ae-7243ae845ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.603977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a731-753e-449d-93ae-7243ae845ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.608578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d764a-b046-49c5-91d6-44cc73c80f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ac8d764a-b046-49c5-91d6-44cc73c80f6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:45.614040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:45.615690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:45.616519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 178/355] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:45.620606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d764a-b046-49c5-91d6-44cc73c80f6b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.620747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.691981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63a731-753e-449d-93ae-7243ae845ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:45.694184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63a731-753e-449d-93ae-7243ae845ce9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:45.739134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d764a-b046-49c5-91d6-44cc73c80f6b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.751795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.781908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb44df8-9b97-4a1e-814d-78186eea6c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.782537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44df8-9b97-4a1e-814d-78186eea6c4d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.782818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44df8-9b97-4a1e-814d-78186eea6c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.783089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44df8-9b97-4a1e-814d-78186eea6c4d None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.784341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb44df8-9b97-4a1e-814d-78186eea6c4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:45.784341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb44df8-9b97-4a1e-814d-78186eea6c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:45.785459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb44df8-9b97-4a1e-814d-78186eea6c4d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:45.795348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 179/356] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:45.796670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe692-8cc3-4cc8-b2b4-e1c028afa4ca None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.796955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe692-8cc3-4cc8-b2b4-e1c028afa4ca None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.797230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe692-8cc3-4cc8-b2b4-e1c028afa4ca None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.798419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 180/357] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:45.799109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe692-8cc3-4cc8-b2b4-e1c028afa4ca None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.826515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 178/358] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:45.828020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63a731-753e-449d-93ae-7243ae845ce9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:45.873718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:45.933672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe692-8cc3-4cc8-b2b4-e1c028afa4ca None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.941643 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63a731-753e-449d-93ae-7243ae845ce9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:45.973317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.973679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.973951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.974223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.975648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] RBAC: Adding query filter params (group.id=7d66bf63efd74f8480f6a69946c931ec, role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:45.976043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:45.978531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:45.980993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61787c-cf2c-4973-97ce-6797719764f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:45.981607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61787c-cf2c-4973-97ce-6797719764f6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:45.981893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61787c-cf2c-4973-97ce-6797719764f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:45.984242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61787c-cf2c-4973-97ce-6797719764f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:45.984356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 181/359] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/role_assignments?group.id=7d66bf63efd74f8480f6a69946c931ec&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=943b210730ce4efdaa3903233fba5962 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:45.984356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:46.028320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:46.076323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61787c-cf2c-4973-97ce-6797719764f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:46.077895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61787c-cf2c-4973-97ce-6797719764f6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:46.132759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39769-c0c9-4abd-9844-e6e68221e3d9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:46.138464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:46.187007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:46.188265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:46.188772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:46.189048 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:46.189725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:46.190026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:46.191403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:46.203696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 182/360] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:46.204368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:46.218917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 179/361] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:46.220323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d2dd-7066-4c23-baf6-c2dd354e55d0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:46.220640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d2dd-7066-4c23-baf6-c2dd354e55d0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:46.220916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d2dd-7066-4c23-baf6-c2dd354e55d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:46.239682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-32c6d2dd-7066-4c23-baf6-c2dd354e55d0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:46.241379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-32c6d2dd-7066-4c23-baf6-c2dd354e55d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:46.329732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:46.335938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5ebaf-0b68-49d5-9ea9-0b5b2faf7a20 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:46.340817 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 180/362] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:46.342021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d2dd-7066-4c23-baf6-c2dd354e55d0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:46.383245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e2d7-4af3-41a4-852b-d08cae0579f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:46.384256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e2d7-4af3-41a4-852b-d08cae0579f4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:46.384774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e2d7-4af3-41a4-852b-d08cae0579f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:46.385277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e2d7-4af3-41a4-852b-d08cae0579f4 None admin] PATH_INFO: `/v3/users/7a07a1884143470cbcacf8b5ef1f759e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:46.386649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e2d7-4af3-41a4-852b-d08cae0579f4 None admin] RBAC: Authorizing `identity:get_user(user_id=7a07a1884143470cbcacf8b5ef1f759e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:46.388092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e2d7-4af3-41a4-852b-d08cae0579f4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:46.389708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 183/363] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:49:46 2022] GET /identity/v3/users/7a07a1884143470cbcacf8b5ef1f759e => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:46.394892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e2d7-4af3-41a4-852b-d08cae0579f4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:46.453193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:46.493681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d2dd-7066-4c23-baf6-c2dd354e55d0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:46.530831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b0439-4ead-4243-b635-e73ccfde2124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:46.531479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b0439-4ead-4243-b635-e73ccfde2124 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:46.531760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b0439-4ead-4243-b635-e73ccfde2124 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:46.531867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e2d7-4af3-41a4-852b-d08cae0579f4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:46.532035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b0439-4ead-4243-b635-e73ccfde2124 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:46.535160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b0439-4ead-4243-b635-e73ccfde2124 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:46.536720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b0439-4ead-4243-b635-e73ccfde2124 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:46.539111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 181/364] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:46 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:46.539713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b0439-4ead-4243-b635-e73ccfde2124 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:46.575347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0446-80ac-4aaf-a200-02689846dc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:46.576299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0446-80ac-4aaf-a200-02689846dc6e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:46.576907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0446-80ac-4aaf-a200-02689846dc6e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:46.577198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0446-80ac-4aaf-a200-02689846dc6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:46.620130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:46.667283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b0439-4ead-4243-b635-e73ccfde2124 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:46.673136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0446-80ac-4aaf-a200-02689846dc6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:46.674618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0446-80ac-4aaf-a200-02689846dc6e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:46.709801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc4ac8-b6f7-4001-b7fc-e1989dbf8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:46.710454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc4ac8-b6f7-4001-b7fc-e1989dbf8f68 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:46.710736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc4ac8-b6f7-4001-b7fc-e1989dbf8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:46.711011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc4ac8-b6f7-4001-b7fc-e1989dbf8f68 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:46.713243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc4ac8-b6f7-4001-b7fc-e1989dbf8f68 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:46.714726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc4ac8-b6f7-4001-b7fc-e1989dbf8f68 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:46.716513 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 182/365] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:46 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:46.720856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc4ac8-b6f7-4001-b7fc-e1989dbf8f68 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:46.731067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:46.814465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 184/366] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:46.815295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0446-80ac-4aaf-a200-02689846dc6e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:46.865871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc4ac8-b6f7-4001-b7fc-e1989dbf8f68 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:46.901976 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:46.914409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:46.915029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:46.915381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:46.915652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:46.916396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] RBAC: Adding query filter params (role.id=ca153d9f3fae4e60b97c36c60d357c55, user.id=7a07a1884143470cbcacf8b5ef1f759e, scope.system=all) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:46.916762 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:46.918243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:46.931573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 183/367] 10.222.0.75 () {56 vars in 1308 bytes} [Mon Sep 19 14:49:46 2022] GET /identity/v3/role_assignments?user.id=7a07a1884143470cbcacf8b5ef1f759e&scope.system=all&role.id=ca153d9f3fae4e60b97c36c60d357c55 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:46.937507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:46.951719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0446-80ac-4aaf-a200-02689846dc6e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.009263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e93da-0bb3-46d3-a3b4-cf14dd9a8e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.010443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e93da-0bb3-46d3-a3b4-cf14dd9a8e41 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.010877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e93da-0bb3-46d3-a3b4-cf14dd9a8e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.011613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e93da-0bb3-46d3-a3b4-cf14dd9a8e41 None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.013878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e93da-0bb3-46d3-a3b4-cf14dd9a8e41 None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:47.016349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:47.017092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e93da-0bb3-46d3-a3b4-cf14dd9a8e41 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:47.026408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 185/368] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:46 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:47.026878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e93da-0bb3-46d3-a3b4-cf14dd9a8e41 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:47.082576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ace68-e08c-4a36-9d5b-85c39baabf29 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.134695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fdadf-91d2-4eee-a7bf-3451a671d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.135350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fdadf-91d2-4eee-a7bf-3451a671d885 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.135784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fdadf-91d2-4eee-a7bf-3451a671d885 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.136199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fdadf-91d2-4eee-a7bf-3451a671d885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.154307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fdadf-91d2-4eee-a7bf-3451a671d885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:47.159614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e93da-0bb3-46d3-a3b4-cf14dd9a8e41 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4e0fdadf-91d2-4eee-a7bf-3451a671d885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:47.159737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:47.160597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:47.161400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:47.165042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 184/369] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:47.165839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fdadf-91d2-4eee-a7bf-3451a671d885 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:47.207247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:47.212757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abba6-e0c2-4328-9495-5499ddcbaa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.214096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abba6-e0c2-4328-9495-5499ddcbaa7e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.214688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abba6-e0c2-4328-9495-5499ddcbaa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.215192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abba6-e0c2-4328-9495-5499ddcbaa7e None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.216759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93abba6-e0c2-4328-9495-5499ddcbaa7e None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:47.219564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93abba6-e0c2-4328-9495-5499ddcbaa7e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:47.221840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 186/370] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:47 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:47.223106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abba6-e0c2-4328-9495-5499ddcbaa7e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:47.291944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fdadf-91d2-4eee-a7bf-3451a671d885 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.324400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:47.339499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586af7-9d12-4d7e-b67a-ef3e721cd6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.339499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586af7-9d12-4d7e-b67a-ef3e721cd6ad None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.339499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586af7-9d12-4d7e-b67a-ef3e721cd6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.339499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586af7-9d12-4d7e-b67a-ef3e721cd6ad None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.339863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a586af7-9d12-4d7e-b67a-ef3e721cd6ad None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:47.341288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a586af7-9d12-4d7e-b67a-ef3e721cd6ad None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:47.342958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 185/371] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:47 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:47.343649 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586af7-9d12-4d7e-b67a-ef3e721cd6ad None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:47.358123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abba6-e0c2-4328-9495-5499ddcbaa7e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.408158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.408841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.409122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.409393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.410123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] RBAC: Adding query filter params (group.id=7d66bf63efd74f8480f6a69946c931ec, role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:47.410430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:47.414530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:47.420650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 187/372] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:47 2022] GET /identity/v3/role_assignments?group.id=7d66bf63efd74f8480f6a69946c931ec&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:47.421485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:47.484233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586af7-9d12-4d7e-b67a-ef3e721cd6ad None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.505094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:47.534507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.535384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.535668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.535943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.537552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:47.538102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:47.539851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:47.556280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 186/373] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:47.556280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:47.565736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bb3a3-89b2-40b5-b8cd-040c6ef6a657 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.611274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.612515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.612515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.612515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.613194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] RBAC: Adding query filter params (group.id=7d66bf63efd74f8480f6a69946c931ec, role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=165361dc47704cb28d965f63da95703d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:47.613499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:47.615019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:47.625020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 188/374] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:47 2022] GET /identity/v3/role_assignments?group.id=7d66bf63efd74f8480f6a69946c931ec&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=943b210730ce4efdaa3903233fba5962 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:47.625882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:47.645259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:47.769826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e612b-72e2-47e3-a274-151f5d8d9ab3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.774368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074505d0-519e-411b-9ade-9baa2cc35a05 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:47.824137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:47.834617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856944-4ba8-40c4-8d4f-0dd6dfff21a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.835667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856944-4ba8-40c4-8d4f-0dd6dfff21a1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.836090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856944-4ba8-40c4-8d4f-0dd6dfff21a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.836202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ec6d1-840f-4056-8c1b-e6e64d212f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:47.836648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856944-4ba8-40c4-8d4f-0dd6dfff21a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.837272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec6d1-840f-4056-8c1b-e6e64d212f3e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:47.837611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec6d1-840f-4056-8c1b-e6e64d212f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:47.837966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ec6d1-840f-4056-8c1b-e6e64d212f3e None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:47.839245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ec6d1-840f-4056-8c1b-e6e64d212f3e None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:47.841570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ec6d1-840f-4056-8c1b-e6e64d212f3e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:47.842944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 187/375] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:47 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:47.852000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ec6d1-840f-4056-8c1b-e6e64d212f3e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:47.950924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856944-4ba8-40c4-8d4f-0dd6dfff21a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:47.952305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856944-4ba8-40c4-8d4f-0dd6dfff21a1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:48.017369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ec6d1-840f-4056-8c1b-e6e64d212f3e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:48.047544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:48.065592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:48.066234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.066527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.066812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.067570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] RBAC: Adding query filter params (group.id=7d66bf63efd74f8480f6a69946c931ec, role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=165361dc47704cb28d965f63da95703d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:48.067888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:48.069991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:48.083040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 188/376] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:47 2022] GET /identity/v3/role_assignments?group.id=7d66bf63efd74f8480f6a69946c931ec&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:48.136022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 189/377] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:48.141616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:48.288220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab905d-48d7-4639-88c6-2d6b9f2e53ed None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:48.343602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6e192-c485-44fd-963d-406c9c40b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:48.345111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6e192-c485-44fd-963d-406c9c40b74c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.345623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6e192-c485-44fd-963d-406c9c40b74c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.346099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6e192-c485-44fd-963d-406c9c40b74c None admin] PATH_INFO: `/v3/projects/9905c16dd71145d6a307772e4fe88d81` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.347705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6e192-c485-44fd-963d-406c9c40b74c None admin] RBAC: Authorizing `identity:get_project(project_id=9905c16dd71145d6a307772e4fe88d81)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:48.349546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6e192-c485-44fd-963d-406c9c40b74c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:48.351577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 189/378] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:48 2022] GET /identity/v3/projects/9905c16dd71145d6a307772e4fe88d81 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:48.357340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856944-4ba8-40c4-8d4f-0dd6dfff21a1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:48.407624 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:48.472623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f54cad-2a39-4636-8b0d-221d069651a8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.472953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f54cad-2a39-4636-8b0d-221d069651a8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.473176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f54cad-2a39-4636-8b0d-221d069651a8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.476039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 190/379] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:48.480363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac716ec-c2c4-42db-9464-36eadd331a22 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.480676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac716ec-c2c4-42db-9464-36eadd331a22 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.480950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac716ec-c2c4-42db-9464-36eadd331a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.514647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856944-4ba8-40c4-8d4f-0dd6dfff21a1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:48.532725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7ac716ec-c2c4-42db-9464-36eadd331a22 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:48.533940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7ac716ec-c2c4-42db-9464-36eadd331a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:48.555988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90488364-a47d-4c94-8a63-51d540e8c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:48.557074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488364-a47d-4c94-8a63-51d540e8c3eb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.557560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488364-a47d-4c94-8a63-51d540e8c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.558023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488364-a47d-4c94-8a63-51d540e8c3eb None admin] PATH_INFO: `/v3/groups/7e5958035e4c461cbc8a69edefb3ea56` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.565036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90488364-a47d-4c94-8a63-51d540e8c3eb None admin] RBAC: Authorizing `identity:get_group(group_id=7e5958035e4c461cbc8a69edefb3ea56)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:48.566710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90488364-a47d-4c94-8a63-51d540e8c3eb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:48.569622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 190/380] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:48 2022] GET /identity/v3/groups/7e5958035e4c461cbc8a69edefb3ea56 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:48.576860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90488364-a47d-4c94-8a63-51d540e8c3eb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:48.633580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:48.653251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 191/381] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:48.757670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:48.766787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90488364-a47d-4c94-8a63-51d540e8c3eb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:48.825052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:48.825672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:48.825953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:48.826228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:48.826968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] RBAC: Adding query filter params (group.id=7e5958035e4c461cbc8a69edefb3ea56, role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=9905c16dd71145d6a307772e4fe88d81) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:48.827282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:48.828736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:48.841250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 191/382] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:48 2022] GET /identity/v3/role_assignments?group.id=7e5958035e4c461cbc8a69edefb3ea56&scope.project.id=9905c16dd71145d6a307772e4fe88d81&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:49.127035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac716ec-c2c4-42db-9464-36eadd331a22 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:49.267193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac716ec-c2c4-42db-9464-36eadd331a22 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:49.320562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bf4e4-7288-4123-9f7c-cbcdb17355f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:49.321207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf4e4-7288-4123-9f7c-cbcdb17355f7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:49.321491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf4e4-7288-4123-9f7c-cbcdb17355f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:49.321759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf4e4-7288-4123-9f7c-cbcdb17355f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:49.336033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bf4e4-7288-4123-9f7c-cbcdb17355f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2b8bf4e4-7288-4123-9f7c-cbcdb17355f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:49.341277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:49.342132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:49.342978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:49.346855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 192/383] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:49.348089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:49.485132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c95735-7b94-463a-b8c8-945675b73d6a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:49.537496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:49.538303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:49.538584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:49.538860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:49.539530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:49.539833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:49.541227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:49.556277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 192/384] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:49.561844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bf4e4-7288-4123-9f7c-cbcdb17355f7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:49.623874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:49.703035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bf4e4-7288-4123-9f7c-cbcdb17355f7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:49.756409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9813-2ddc-450a-8be3-99518014853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:49.756409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9813-2ddc-450a-8be3-99518014853c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:49.756409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9813-2ddc-450a-8be3-99518014853c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:49.756409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9813-2ddc-450a-8be3-99518014853c None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:49.757734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c9813-2ddc-450a-8be3-99518014853c None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:49.759181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c9813-2ddc-450a-8be3-99518014853c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:49.761152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 193/385] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:49 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:49.766353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:49.797627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:49.991864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a229-7f3d-487c-89d9-948b79ca24a3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:50.034604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bb342-9f17-41c1-8a77-49da1adae25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:50.035227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bb342-9f17-41c1-8a77-49da1adae25f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.035502 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bb342-9f17-41c1-8a77-49da1adae25f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.035774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bb342-9f17-41c1-8a77-49da1adae25f None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.037102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bb342-9f17-41c1-8a77-49da1adae25f None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:50.038622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bb342-9f17-41c1-8a77-49da1adae25f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:50.040745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 193/386] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:49 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:50.046581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9813-2ddc-450a-8be3-99518014853c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:50.111253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9081cd-1a1f-47d1-af14-bddf226bf718 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.111569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9081cd-1a1f-47d1-af14-bddf226bf718 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.111805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9081cd-1a1f-47d1-af14-bddf226bf718 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.113133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 194/387] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:50.119379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ab109-869e-4e3e-843d-751345a633c4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.119861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ab109-869e-4e3e-843d-751345a633c4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.120140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ab109-869e-4e3e-843d-751345a633c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.140404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ec9ab109-869e-4e3e-843d-751345a633c4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:50.142028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ec9ab109-869e-4e3e-843d-751345a633c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:50.231320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9813-2ddc-450a-8be3-99518014853c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:50.240590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 195/388] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:50.251802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:50.274532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eca57-d1d6-4bb0-a2b0-3c14b6ec57f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:50.275195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eca57-d1d6-4bb0-a2b0-3c14b6ec57f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.275471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eca57-d1d6-4bb0-a2b0-3c14b6ec57f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.275742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eca57-d1d6-4bb0-a2b0-3c14b6ec57f0 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/groups/7d66bf63efd74f8480f6a69946c931ec/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.277683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eca57-d1d6-4bb0-a2b0-3c14b6ec57f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4a109b72e24a4fa4e3a27969f781d4, group_id=7d66bf63efd74f8480f6a69946c931ec, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:50.279118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eca57-d1d6-4bb0-a2b0-3c14b6ec57f0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:50.334604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feddcd-c2ba-4187-a958-19729374de00 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.335040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feddcd-c2ba-4187-a958-19729374de00 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.335338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feddcd-c2ba-4187-a958-19729374de00 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.336761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 196/389] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:50.345918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd691-eeab-429a-8c25-6e6d11a860bc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.346205 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd691-eeab-429a-8c25-6e6d11a860bc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.346478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd691-eeab-429a-8c25-6e6d11a860bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.366371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 194/390] 10.222.0.75 () {58 vars in 1442 bytes} [Mon Sep 19 14:49:50 2022] PUT /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/groups/7d66bf63efd74f8480f6a69946c931ec/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:50.373751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-06ecd691-eeab-429a-8c25-6e6d11a860bc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:50.374980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-06ecd691-eeab-429a-8c25-6e6d11a860bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:50.395802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:50.469709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 197/391] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:49:50.667241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eca57-d1d6-4bb0-a2b0-3c14b6ec57f0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:50.787809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd691-eeab-429a-8c25-6e6d11a860bc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:50.812546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eca57-d1d6-4bb0-a2b0-3c14b6ec57f0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:50.860749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8783-d27f-4bdc-b932-22c77ff61671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:50.861393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8783-d27f-4bdc-b932-22c77ff61671 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.861797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8783-d27f-4bdc-b932-22c77ff61671 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.862197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8783-d27f-4bdc-b932-22c77ff61671 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.877020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a8783-d27f-4bdc-b932-22c77ff61671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-fe9a8783-d27f-4bdc-b932-22c77ff61671 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:50.884865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:50.885947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:50.886925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:50.889211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 195/392] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:50.890533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948bb4f-9290-4462-80c1-5b7d19cbc670 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.890953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948bb4f-9290-4462-80c1-5b7d19cbc670 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.891891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948bb4f-9290-4462-80c1-5b7d19cbc670 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.893325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 196/393] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:50.898228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948bb4f-9290-4462-80c1-5b7d19cbc670 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:50.926500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd691-eeab-429a-8c25-6e6d11a860bc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:50.940775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:50.972791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afee45-66dd-4702-8b6a-74207156dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:50.973435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afee45-66dd-4702-8b6a-74207156dd89 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:50.973717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afee45-66dd-4702-8b6a-74207156dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:50.973994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afee45-66dd-4702-8b6a-74207156dd89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:50.988450 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afee45-66dd-4702-8b6a-74207156dd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c5afee45-66dd-4702-8b6a-74207156dd89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:50.994843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:51.002826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 198/394] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:49:51.003629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fc20f-20b6-4bfb-a480-46b9a0658889 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.004343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fc20f-20b6-4bfb-a480-46b9a0658889 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.004343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fc20f-20b6-4bfb-a480-46b9a0658889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.017108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:51.028678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0f9fc20f-20b6-4bfb-a480-46b9a0658889 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:51.029884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0f9fc20f-20b6-4bfb-a480-46b9a0658889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:51.042848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948bb4f-9290-4462-80c1-5b7d19cbc670 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:51.080357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f25448-adff-46db-aa60-5188add349db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:51.081005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f25448-adff-46db-aa60-5188add349db None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.081286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f25448-adff-46db-aa60-5188add349db None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.081725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f25448-adff-46db-aa60-5188add349db None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.082236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f25448-adff-46db-aa60-5188add349db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:51.082540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f25448-adff-46db-aa60-5188add349db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:51.085331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f25448-adff-46db-aa60-5188add349db None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:51.100246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 197/395] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:51.101035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f25448-adff-46db-aa60-5188add349db None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:51.132680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 199/396] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:51.134044 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fc20f-20b6-4bfb-a480-46b9a0658889 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:51.264008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:51.277366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f25448-adff-46db-aa60-5188add349db None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:51.315260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fc20f-20b6-4bfb-a480-46b9a0658889 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:51.330529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:51.331137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.331417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.331708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.332389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:51.339705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:51.339705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:51.358844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 198/397] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:51.360312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:51.395016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c9a0-c7ab-46e2-9337-3f431937b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:51.395664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c9a0-c7ab-46e2-9337-3f431937b44a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.395945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c9a0-c7ab-46e2-9337-3f431937b44a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.396281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2c9a0-c7ab-46e2-9337-3f431937b44a None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.399129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2c9a0-c7ab-46e2-9337-3f431937b44a None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:51.400593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2c9a0-c7ab-46e2-9337-3f431937b44a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:51.410664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 200/398] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:51 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:51.413802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c9a0-c7ab-46e2-9337-3f431937b44a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:51.420776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:51.536740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b55867-1ada-4f83-98bf-f92aceb7fc0a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:51.572264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd69abc-a950-41fb-af4e-df2529d115c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:51.572926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd69abc-a950-41fb-af4e-df2529d115c9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.573266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd69abc-a950-41fb-af4e-df2529d115c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.573605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd69abc-a950-41fb-af4e-df2529d115c9 None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.574927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd69abc-a950-41fb-af4e-df2529d115c9 None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:51.576157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd69abc-a950-41fb-af4e-df2529d115c9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:51.577945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2c9a0-c7ab-46e2-9337-3f431937b44a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:51.578122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 199/399] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:51 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:51.578965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd69abc-a950-41fb-af4e-df2529d115c9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:51.606861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:51.617926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6385d1-4506-414e-98ce-278b79de31d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:51.628113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6385d1-4506-414e-98ce-278b79de31d0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.628113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6385d1-4506-414e-98ce-278b79de31d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.628113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6385d1-4506-414e-98ce-278b79de31d0 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.628113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6385d1-4506-414e-98ce-278b79de31d0 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:51.628113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6385d1-4506-414e-98ce-278b79de31d0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:51.628113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 201/400] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:51 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:51.628608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8901f-460a-451c-b082-faa45a83e9a8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.628608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8901f-460a-451c-b082-faa45a83e9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.628608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8901f-460a-451c-b082-faa45a83e9a8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.628608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 202/401] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:51.628608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8901f-460a-451c-b082-faa45a83e9a8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:51.692531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd69abc-a950-41fb-af4e-df2529d115c9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:51.706799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:51.728439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9507-1dc5-46f8-b33e-4ac0f67c930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:51.729181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9507-1dc5-46f8-b33e-4ac0f67c930b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.729467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9507-1dc5-46f8-b33e-4ac0f67c930b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.729748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9507-1dc5-46f8-b33e-4ac0f67c930b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.738438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8901f-460a-451c-b082-faa45a83e9a8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:51.740697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d9507-1dc5-46f8-b33e-4ac0f67c930b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-624d9507-1dc5-46f8-b33e-4ac0f67c930b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:51.746180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:51.747091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:51.747859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 200/402] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:51.748527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9507-1dc5-46f8-b33e-4ac0f67c930b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:51.786506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3281a40-2e0d-4a39-94c5-5ace4266cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:51.788390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3281a40-2e0d-4a39-94c5-5ace4266cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.789300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3281a40-2e0d-4a39-94c5-5ace4266cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.789582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3281a40-2e0d-4a39-94c5-5ace4266cfa5 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.790772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3281a40-2e0d-4a39-94c5-5ace4266cfa5 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:51.792196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3281a40-2e0d-4a39-94c5-5ace4266cfa5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:51.798660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 203/403] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:51 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:51.798660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914203a-4aa0-4eb9-b230-d9bd9398b413 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.798660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914203a-4aa0-4eb9-b230-d9bd9398b413 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.798660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914203a-4aa0-4eb9-b230-d9bd9398b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.814509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5914203a-4aa0-4eb9-b230-d9bd9398b413 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:51.815701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5914203a-4aa0-4eb9-b230-d9bd9398b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:51.850658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:51.872241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9507-1dc5-46f8-b33e-4ac0f67c930b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:51.900218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 204/404] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:51.901342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914203a-4aa0-4eb9-b230-d9bd9398b413 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:51.917698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8436c-524f-40d1-9a3f-b060f2ff4fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:51.918706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8436c-524f-40d1-9a3f-b060f2ff4fc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:51.919130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8436c-524f-40d1-9a3f-b060f2ff4fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:51.919545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8436c-524f-40d1-9a3f-b060f2ff4fc5 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/groups/7d66bf63efd74f8480f6a69946c931ec/roles/3b586edbe9c24d7288ee1a8e48781662` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:51.921974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8436c-524f-40d1-9a3f-b060f2ff4fc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4a109b72e24a4fa4e3a27969f781d4, group_id=7d66bf63efd74f8480f6a69946c931ec, role_id=3b586edbe9c24d7288ee1a8e48781662)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:51.923667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8436c-524f-40d1-9a3f-b060f2ff4fc5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:51.978062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:52.008112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914203a-4aa0-4eb9-b230-d9bd9398b413 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.043991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.044557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.044845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.045123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.045791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:52.046103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:52.053266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:52.053847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 201/405] 10.222.0.75 () {58 vars in 1442 bytes} [Mon Sep 19 14:49:51 2022] PUT /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4/groups/7d66bf63efd74f8480f6a69946c931ec/roles/3b586edbe9c24d7288ee1a8e48781662 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:52.055171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8436c-524f-40d1-9a3f-b060f2ff4fc5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:52.063219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 205/406] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:52.069435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:52.244958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8436c-524f-40d1-9a3f-b060f2ff4fc5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.252523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6507-7c09-4c1b-889a-98a1f5037803 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.289634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:52.296077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f2ec-e63b-4adb-be8a-b3554d912c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.297088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f2ec-e63b-4adb-be8a-b3554d912c0c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.297088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f2ec-e63b-4adb-be8a-b3554d912c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.297251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f2ec-e63b-4adb-be8a-b3554d912c0c None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.299172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f2ec-e63b-4adb-be8a-b3554d912c0c None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:52.305328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f2ec-e63b-4adb-be8a-b3554d912c0c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:52.305442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f88a3-3768-4a52-8467-6abd53ceb8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.305442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f88a3-3768-4a52-8467-6abd53ceb8db None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.305442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f88a3-3768-4a52-8467-6abd53ceb8db None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.305442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f88a3-3768-4a52-8467-6abd53ceb8db None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d/groups/7d66bf63efd74f8480f6a69946c931ec/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.305704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 206/407] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:52 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:52.305704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f2ec-e63b-4adb-be8a-b3554d912c0c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:52.307376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f88a3-3768-4a52-8467-6abd53ceb8db None admin] RBAC: Authorizing `identity:create_grant(project_id=165361dc47704cb28d965f63da95703d, group_id=7d66bf63efd74f8480f6a69946c931ec, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:52.308983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f88a3-3768-4a52-8467-6abd53ceb8db None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:52.414278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f2ec-e63b-4adb-be8a-b3554d912c0c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.449435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9da95-1c85-4426-8fea-c5c6cc47cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.450070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9da95-1c85-4426-8fea-c5c6cc47cabf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.450347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9da95-1c85-4426-8fea-c5c6cc47cabf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.450617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9da95-1c85-4426-8fea-c5c6cc47cabf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.463845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9da95-1c85-4426-8fea-c5c6cc47cabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:52.472243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 202/408] 10.222.0.75 () {58 vars in 1442 bytes} [Mon Sep 19 14:49:52 2022] PUT /identity/v3/projects/165361dc47704cb28d965f63da95703d/groups/7d66bf63efd74f8480f6a69946c931ec/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6cc9da95-1c85-4426-8fea-c5c6cc47cabf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:52.472435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:52.473451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 207/409] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:52.475047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9da95-1c85-4426-8fea-c5c6cc47cabf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:52.479522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f88a3-3768-4a52-8467-6abd53ceb8db None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:52.491395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:52.608075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:52.698297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9da95-1c85-4426-8fea-c5c6cc47cabf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.702699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f88a3-3768-4a52-8467-6abd53ceb8db None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.762273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.762907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.763012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc785d1-81a1-4a06-8777-77a12f24cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.763205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.763457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.763548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc785d1-81a1-4a06-8777-77a12f24cff5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.763842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc785d1-81a1-4a06-8777-77a12f24cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.764117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc785d1-81a1-4a06-8777-77a12f24cff5 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.764215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:52.764428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:52.765316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc785d1-81a1-4a06-8777-77a12f24cff5 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:52.765833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:52.766749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc785d1-81a1-4a06-8777-77a12f24cff5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:52.768570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 208/410] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:52 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:52.776443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 203/411] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:52.782839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc785d1-81a1-4a06-8777-77a12f24cff5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:52.784072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:52.866986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:52.901839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc785d1-81a1-4a06-8777-77a12f24cff5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.906114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee182d-130e-41c9-aeec-cc7e8a4163b2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:52.932142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:52.940251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e65728-e7fb-445c-ba97-c6ce9c0ab890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.941143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e65728-e7fb-445c-ba97-c6ce9c0ab890 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.941431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e65728-e7fb-445c-ba97-c6ce9c0ab890 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.942205 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e65728-e7fb-445c-ba97-c6ce9c0ab890 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d/groups/7d66bf63efd74f8480f6a69946c931ec/roles/3b586edbe9c24d7288ee1a8e48781662` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.944858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e65728-e7fb-445c-ba97-c6ce9c0ab890 None admin] RBAC: Authorizing `identity:create_grant(project_id=165361dc47704cb28d965f63da95703d, group_id=7d66bf63efd74f8480f6a69946c931ec, role_id=3b586edbe9c24d7288ee1a8e48781662)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:52.945710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed267b6-5e1e-4c72-bcf4-a8afd77f4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:52.946342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e65728-e7fb-445c-ba97-c6ce9c0ab890 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:52.946800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed267b6-5e1e-4c72-bcf4-a8afd77f4736 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.947294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed267b6-5e1e-4c72-bcf4-a8afd77f4736 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.947757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed267b6-5e1e-4c72-bcf4-a8afd77f4736 None admin] PATH_INFO: `/v3/groups/7e5958035e4c461cbc8a69edefb3ea56` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.949108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed267b6-5e1e-4c72-bcf4-a8afd77f4736 None admin] RBAC: Authorizing `identity:get_group(group_id=7e5958035e4c461cbc8a69edefb3ea56)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:52.951084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed267b6-5e1e-4c72-bcf4-a8afd77f4736 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:52.953014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 204/412] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:52 2022] GET /identity/v3/groups/7e5958035e4c461cbc8a69edefb3ea56 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:52.954181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2adcc0-ed07-4d05-99f7-1559202196b7 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:52.954559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2adcc0-ed07-4d05-99f7-1559202196b7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:52.954933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2adcc0-ed07-4d05-99f7-1559202196b7 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:52.956399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 205/413] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:52.962259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2adcc0-ed07-4d05-99f7-1559202196b7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:53.028592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 209/414] 10.222.0.75 () {58 vars in 1442 bytes} [Mon Sep 19 14:49:52 2022] PUT /identity/v3/projects/165361dc47704cb28d965f63da95703d/groups/7d66bf63efd74f8480f6a69946c931ec/roles/3b586edbe9c24d7288ee1a8e48781662 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:53.030301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3efc-912c-42ac-bdfb-14c41103e1de None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:53.030676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3efc-912c-42ac-bdfb-14c41103e1de None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:53.031046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3efc-912c-42ac-bdfb-14c41103e1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:53.069631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-848a3efc-912c-42ac-bdfb-14c41103e1de None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:53.071097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-848a3efc-912c-42ac-bdfb-14c41103e1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:53.094324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2adcc0-ed07-4d05-99f7-1559202196b7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:53.155456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48387e-c391-4f61-8542-8d79b987230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:53.156367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48387e-c391-4f61-8542-8d79b987230e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:53.158186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48387e-c391-4f61-8542-8d79b987230e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:53.158782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48387e-c391-4f61-8542-8d79b987230e None admin] PATH_INFO: `/v3/projects/9905c16dd71145d6a307772e4fe88d81` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:53.161583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48387e-c391-4f61-8542-8d79b987230e None admin] RBAC: Authorizing `identity:get_project(project_id=9905c16dd71145d6a307772e4fe88d81)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:53.165197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48387e-c391-4f61-8542-8d79b987230e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:53.171395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 206/415] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:52 2022] GET /identity/v3/projects/9905c16dd71145d6a307772e4fe88d81 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:53.179797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48387e-c391-4f61-8542-8d79b987230e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:53.183640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:53.232635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 210/416] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:53.325053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48387e-c391-4f61-8542-8d79b987230e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:53.364026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db90e-60f2-4aa6-ae5d-4a31b971eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:53.364711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db90e-60f2-4aa6-ae5d-4a31b971eab5 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:53.365628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db90e-60f2-4aa6-ae5d-4a31b971eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:53.365899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1db90e-60f2-4aa6-ae5d-4a31b971eab5 None admin] PATH_INFO: `/v3/projects/9905c16dd71145d6a307772e4fe88d81/groups/7e5958035e4c461cbc8a69edefb3ea56/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:53.367829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1db90e-60f2-4aa6-ae5d-4a31b971eab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9905c16dd71145d6a307772e4fe88d81, group_id=7e5958035e4c461cbc8a69edefb3ea56, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:53.369325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1db90e-60f2-4aa6-ae5d-4a31b971eab5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:53.462267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 207/417] 10.222.0.75 () {58 vars in 1442 bytes} [Mon Sep 19 14:49:53 2022] PUT /identity/v3/projects/9905c16dd71145d6a307772e4fe88d81/groups/7e5958035e4c461cbc8a69edefb3ea56/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:49:53.577957 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3efc-912c-42ac-bdfb-14c41103e1de None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:53.694274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3efc-912c-42ac-bdfb-14c41103e1de None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:53.715303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:53.735289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ec42e-dd97-4551-934b-213a8cd0fbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:53.736303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec42e-dd97-4551-934b-213a8cd0fbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:53.736831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec42e-dd97-4551-934b-213a8cd0fbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:53.737327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec42e-dd97-4551-934b-213a8cd0fbe9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:53.749233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ec42e-dd97-4551-934b-213a8cd0fbe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6e8ec42e-dd97-4551-934b-213a8cd0fbe9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:53.756070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:53.757357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:53.758177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:53.766176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 211/418] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:53.767795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db90e-60f2-4aa6-ae5d-4a31b971eab5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:53.844751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:53.890067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1db90e-60f2-4aa6-ae5d-4a31b971eab5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:53.954351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:53.954965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:53.955245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:53.955517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:53.956189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:53.956504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:53.957993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:53.972572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 208/419] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:53.979020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ec42e-dd97-4551-934b-213a8cd0fbe9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:54.104337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ec42e-dd97-4551-934b-213a8cd0fbe9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:54.141368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ed03b-6be7-4d41-b20e-29e46595a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:54.141988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ed03b-6be7-4d41-b20e-29e46595a51d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:54.142276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ed03b-6be7-4d41-b20e-29e46595a51d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:54.142551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ed03b-6be7-4d41-b20e-29e46595a51d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:54.193927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:54.217283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ed03b-6be7-4d41-b20e-29e46595a51d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:54.218811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ed03b-6be7-4d41-b20e-29e46595a51d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:54.355376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 212/420] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:54.361271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:54.531432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f468d94-be03-4ac5-a426-686d4b6d7153 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:54.533192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7722-fcf8-472d-aae5-17ebb78ab136 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:54.533484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7722-fcf8-472d-aae5-17ebb78ab136 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:54.533768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7722-fcf8-472d-aae5-17ebb78ab136 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:54.538758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 213/421] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:54.544423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dbc5f-8a31-4caa-808f-553d90f48277 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:54.544782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dbc5f-8a31-4caa-808f-553d90f48277 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:54.545073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dbc5f-8a31-4caa-808f-553d90f48277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:54.559124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:54.582231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-212dbc5f-8a31-4caa-808f-553d90f48277 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:54.583444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-212dbc5f-8a31-4caa-808f-553d90f48277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:54.586221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d087f1-88d8-4f77-babc-341b6370adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:54.587388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d087f1-88d8-4f77-babc-341b6370adb6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:54.587900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d087f1-88d8-4f77-babc-341b6370adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:54.588402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d087f1-88d8-4f77-babc-341b6370adb6 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:54.593198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d087f1-88d8-4f77-babc-341b6370adb6 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:54.594943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d087f1-88d8-4f77-babc-341b6370adb6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:54.600815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 209/422] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:54 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:54.603847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d087f1-88d8-4f77-babc-341b6370adb6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:54.700171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 214/423] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:54.778979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d087f1-88d8-4f77-babc-341b6370adb6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:54.832080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9765148-6d26-4ee3-9767-5570743543b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:54.832740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765148-6d26-4ee3-9767-5570743543b6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:54.833022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765148-6d26-4ee3-9767-5570743543b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:54.833369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765148-6d26-4ee3-9767-5570743543b6 None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:54.837446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9765148-6d26-4ee3-9767-5570743543b6 None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:54.840818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9765148-6d26-4ee3-9767-5570743543b6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:54.840957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 210/424] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:54 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:54.848674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dbc5f-8a31-4caa-808f-553d90f48277 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:54.860579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:54.964627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dbc5f-8a31-4caa-808f-553d90f48277 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:55.012143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:55.012917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.013028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.013305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.014042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] RBAC: Adding query filter params (group.id=7d66bf63efd74f8480f6a69946c931ec, role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:55.014346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:55.015753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:55.022570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 215/425] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:54 2022] GET /identity/v3/role_assignments?group.id=7d66bf63efd74f8480f6a69946c931ec&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=943b210730ce4efdaa3903233fba5962 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:55.045045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9765148-6d26-4ee3-9767-5570743543b6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:55.124444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:55.160890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9765148-6d26-4ee3-9767-5570743543b6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:55.201991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb85ad-61a3-4c29-bee7-f582b23fdb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:55.202641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb85ad-61a3-4c29-bee7-f582b23fdb0b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.202924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb85ad-61a3-4c29-bee7-f582b23fdb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.203332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb85ad-61a3-4c29-bee7-f582b23fdb0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.216965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb85ad-61a3-4c29-bee7-f582b23fdb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-04cb85ad-61a3-4c29-bee7-f582b23fdb0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:55.222488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:55.223483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:55.225141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 211/426] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:55.230712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:55.309727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:55.341309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c925-bfb5-478d-9774-84c65bf019be None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:55.387977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8ac6-e9a9-47ab-840c-6f3596915395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:55.389058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8ac6-e9a9-47ab-840c-6f3596915395 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.389506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8ac6-e9a9-47ab-840c-6f3596915395 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.389986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8ac6-e9a9-47ab-840c-6f3596915395 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.391103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8ac6-e9a9-47ab-840c-6f3596915395 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:55.391623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8ac6-e9a9-47ab-840c-6f3596915395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:55.393978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8ac6-e9a9-47ab-840c-6f3596915395 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:55.410822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 216/427] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:55.418440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb85ad-61a3-4c29-bee7-f582b23fdb0b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:55.603220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb85ad-61a3-4c29-bee7-f582b23fdb0b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:55.612186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb49c8-88ca-471f-ab52-248cd0270ec8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.612846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb49c8-88ca-471f-ab52-248cd0270ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.613409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb49c8-88ca-471f-ab52-248cd0270ec8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.615388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 217/428] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:55.623311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4bb4-1eb5-47e0-9a22-0ab8d057c97e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.623970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4bb4-1eb5-47e0-9a22-0ab8d057c97e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.624521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4bb4-1eb5-47e0-9a22-0ab8d057c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.639888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:55.660818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7c1b4bb4-1eb5-47e0-9a22-0ab8d057c97e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:55.663154 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c1b4bb4-1eb5-47e0-9a22-0ab8d057c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:55.669311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3619-8aa2-4f3d-b015-09d677a448fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:55.669311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3619-8aa2-4f3d-b015-09d677a448fa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.669311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3619-8aa2-4f3d-b015-09d677a448fa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.669311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3619-8aa2-4f3d-b015-09d677a448fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.804781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf3619-8aa2-4f3d-b015-09d677a448fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:55.808783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf3619-8aa2-4f3d-b015-09d677a448fa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:55.841017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 218/429] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:55.945224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 212/430] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:55.948083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcef8f-708e-4c3c-9e6f-55571dce754e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.948424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcef8f-708e-4c3c-9e6f-55571dce754e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.948734 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcef8f-708e-4c3c-9e6f-55571dce754e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.950446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 219/431] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:55.952966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3619-8aa2-4f3d-b015-09d677a448fa None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:55.958022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280f23-dba2-40da-84ed-48fca5c8139b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:55.958022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280f23-dba2-40da-84ed-48fca5c8139b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:55.958022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280f23-dba2-40da-84ed-48fca5c8139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:55.992198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8c280f23-dba2-40da-84ed-48fca5c8139b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:55.997297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:56.000253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8c280f23-dba2-40da-84ed-48fca5c8139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:56.120552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:56.130559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 220/432] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:56.144327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3619-8aa2-4f3d-b015-09d677a448fa None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:56.189983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be46a7-a9a2-44e0-9b3a-c86d1f427741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:56.190641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be46a7-a9a2-44e0-9b3a-c86d1f427741 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.191096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be46a7-a9a2-44e0-9b3a-c86d1f427741 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.191389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be46a7-a9a2-44e0-9b3a-c86d1f427741 None admin] PATH_INFO: `/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.192570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be46a7-a9a2-44e0-9b3a-c86d1f427741 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4a109b72e24a4fa4e3a27969f781d4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:56.194560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be46a7-a9a2-44e0-9b3a-c86d1f427741 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:56.196887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 213/433] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:55 2022] GET /identity/v3/projects/2b4a109b72e24a4fa4e3a27969f781d4 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:56.202707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280f23-dba2-40da-84ed-48fca5c8139b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:56.222096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be46a7-a9a2-44e0-9b3a-c86d1f427741 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:56.314241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280f23-dba2-40da-84ed-48fca5c8139b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:56.328795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:56.344850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be46a7-a9a2-44e0-9b3a-c86d1f427741 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:56.357749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa9110-aef4-46fd-b1e0-07507daefd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:56.358774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9110-aef4-46fd-b1e0-07507daefd77 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.359248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9110-aef4-46fd-b1e0-07507daefd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.359723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9110-aef4-46fd-b1e0-07507daefd77 None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.361120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa9110-aef4-46fd-b1e0-07507daefd77 None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:56.362889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa9110-aef4-46fd-b1e0-07507daefd77 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:56.364800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 221/434] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:56 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:56.370845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa9110-aef4-46fd-b1e0-07507daefd77 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:56.384393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2cd5e-6366-416c-a53e-b710a39a784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:56.385259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cd5e-6366-416c-a53e-b710a39a784a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.385376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cd5e-6366-416c-a53e-b710a39a784a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.385655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cd5e-6366-416c-a53e-b710a39a784a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.397717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2cd5e-6366-416c-a53e-b710a39a784a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-aef2cd5e-6366-416c-a53e-b710a39a784a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:56.405114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:56.406021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:49:56.406801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:56.411168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 214/435] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:56.418220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2cd5e-6366-416c-a53e-b710a39a784a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:56.449099 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:56.490609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa9110-aef4-46fd-b1e0-07507daefd77 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:56.523516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2cd5e-6366-416c-a53e-b710a39a784a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:56.527216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:56.527829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.528109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.528385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.529298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] RBAC: Adding query filter params (group.id=7d66bf63efd74f8480f6a69946c931ec, role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:56.529609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:56.531044 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:56.537217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 222/436] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:56 2022] GET /identity/v3/role_assignments?group.id=7d66bf63efd74f8480f6a69946c931ec&scope.project.id=2b4a109b72e24a4fa4e3a27969f781d4&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:56.538127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:56.566705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e995-08c3-433f-bb7c-a66871dfc1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:56.567339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e995-08c3-433f-bb7c-a66871dfc1aa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.568873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e995-08c3-433f-bb7c-a66871dfc1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.569149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e995-08c3-433f-bb7c-a66871dfc1aa None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.570199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e995-08c3-433f-bb7c-a66871dfc1aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:56.570552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e995-08c3-433f-bb7c-a66871dfc1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:56.572923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e995-08c3-433f-bb7c-a66871dfc1aa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:56.582897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 215/437] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:56.585479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84173b7-6ac3-446b-b10c-5563ae05b9bc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.585838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84173b7-6ac3-446b-b10c-5563ae05b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.586162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84173b7-6ac3-446b-b10c-5563ae05b9bc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.588122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 216/438] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:49:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:56.593277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84173b7-6ac3-446b-b10c-5563ae05b9bc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:56.608924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:56.667470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5dca3-da8d-4746-9bd4-953684f3a088 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:56.702881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:56.713000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97247f1-fa95-44d2-8523-719c09efa777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:56.713652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97247f1-fa95-44d2-8523-719c09efa777 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.713934 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97247f1-fa95-44d2-8523-719c09efa777 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.714209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97247f1-fa95-44d2-8523-719c09efa777 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.716684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84173b7-6ac3-446b-b10c-5563ae05b9bc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:56.729575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97247f1-fa95-44d2-8523-719c09efa777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b97247f1-fa95-44d2-8523-719c09efa777 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:56.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:56.735514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:49:56.736300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 223/439] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:49:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:56.739070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc10bc-7657-47be-9f5f-73569cf94378 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.739070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc10bc-7657-47be-9f5f-73569cf94378 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.739070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc10bc-7657-47be-9f5f-73569cf94378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.758591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-31fc10bc-7657-47be-9f5f-73569cf94378 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:56.759806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-31fc10bc-7657-47be-9f5f-73569cf94378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:56.767076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1abe-2461-4506-a995-8d9f6b1e1a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:56.767696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1abe-2461-4506-a995-8d9f6b1e1a47 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:56.767979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1abe-2461-4506-a995-8d9f6b1e1a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:56.768256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1abe-2461-4506-a995-8d9f6b1e1a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:56.847223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 224/440] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:49:56.848084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc10bc-7657-47be-9f5f-73569cf94378 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:56.864428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb1abe-2461-4506-a995-8d9f6b1e1a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:56.867615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb1abe-2461-4506-a995-8d9f6b1e1a47 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:56.884618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:56.978988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc10bc-7657-47be-9f5f-73569cf94378 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:56.999001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:57.006227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 217/441] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:57.011493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1abe-2461-4506-a995-8d9f6b1e1a47 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.022579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.023764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.024158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.024507 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.025191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:57.025665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.027693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.040745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 225/442] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:57.045165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.129242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1abe-2461-4506-a995-8d9f6b1e1a47 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.140530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:57.152619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792023a0-e504-43a9-b88e-97eb37660b4a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.164218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dcf41-481b-4b54-a039-279262658069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.164879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dcf41-481b-4b54-a039-279262658069 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.165169 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dcf41-481b-4b54-a039-279262658069 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.165416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dcf41-481b-4b54-a039-279262658069 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.166544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dcf41-481b-4b54-a039-279262658069 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.168054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dcf41-481b-4b54-a039-279262658069 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.170021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 218/443] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:49:57.170782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dcf41-481b-4b54-a039-279262658069 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.192046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcf740-3f0b-485d-aee3-1a773c63345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.192691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcf740-3f0b-485d-aee3-1a773c63345c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.193113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcf740-3f0b-485d-aee3-1a773c63345c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.193385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcf740-3f0b-485d-aee3-1a773c63345c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.246045 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:57.267696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcf740-3f0b-485d-aee3-1a773c63345c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.269177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcf740-3f0b-485d-aee3-1a773c63345c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.273010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dcf41-481b-4b54-a039-279262658069 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.307439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8b67-7b3e-42e2-aead-317f90e27092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.308057 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8b67-7b3e-42e2-aead-317f90e27092 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.308331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8b67-7b3e-42e2-aead-317f90e27092 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.308628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8b67-7b3e-42e2-aead-317f90e27092 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.318976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a8b67-7b3e-42e2-aead-317f90e27092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-831a8b67-7b3e-42e2-aead-317f90e27092 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:49:57.323807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:49:57.324795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:49:57.325584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 219/444] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:49:57.326269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8b67-7b3e-42e2-aead-317f90e27092 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.368362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:57.373080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 226/445] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:49:57.373928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcf740-3f0b-485d-aee3-1a773c63345c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.430087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8b67-7b3e-42e2-aead-317f90e27092 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.452033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:57.466374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8343d91-9219-4ead-bd8a-0438d4da4d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.467011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343d91-9219-4ead-bd8a-0438d4da4d8b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.467298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343d91-9219-4ead-bd8a-0438d4da4d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.467576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343d91-9219-4ead-bd8a-0438d4da4d8b None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.468764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8343d91-9219-4ead-bd8a-0438d4da4d8b None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.470202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8343d91-9219-4ead-bd8a-0438d4da4d8b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.471808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 220/446] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:57.472610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8343d91-9219-4ead-bd8a-0438d4da4d8b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.475321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcf740-3f0b-485d-aee3-1a773c63345c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.511678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.512198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.512494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.512768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.513420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:57.513725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.515067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.523285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 227/447] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:57.524081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.580163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8343d91-9219-4ead-bd8a-0438d4da4d8b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.588107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:57.620579 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617a353-0315-466a-afdb-73478ef90c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.621218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617a353-0315-466a-afdb-73478ef90c28 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.621502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617a353-0315-466a-afdb-73478ef90c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.621778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617a353-0315-466a-afdb-73478ef90c28 None admin] PATH_INFO: `/v3/projects/165361dc47704cb28d965f63da95703d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.622955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617a353-0315-466a-afdb-73478ef90c28 None admin] RBAC: Authorizing `identity:get_project(project_id=165361dc47704cb28d965f63da95703d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.624577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617a353-0315-466a-afdb-73478ef90c28 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.626484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 221/448] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/projects/165361dc47704cb28d965f63da95703d => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:57.627281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617a353-0315-466a-afdb-73478ef90c28 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.638574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a92a9-3841-490a-ac6b-eadec7bdf5cd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.672275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.672905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.673192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.673467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.674185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] RBAC: Adding query filter params (group.id=7d66bf63efd74f8480f6a69946c931ec, role.id=943b210730ce4efdaa3903233fba5962, scope.project.id=165361dc47704cb28d965f63da95703d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:57.674494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.675973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.684283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 228/449] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/role_assignments?group.id=7d66bf63efd74f8480f6a69946c931ec&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=943b210730ce4efdaa3903233fba5962 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:57.685151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.689103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:57.746720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617a353-0315-466a-afdb-73478ef90c28 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.789521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36719f59-83b2-4039-a23c-fdfc8bc921ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.790412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36719f59-83b2-4039-a23c-fdfc8bc921ea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.790844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36719f59-83b2-4039-a23c-fdfc8bc921ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.791275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36719f59-83b2-4039-a23c-fdfc8bc921ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.819824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd43ab1-9d66-4c2c-b4a1-f4b71aca261b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:57.846886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:57.866619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee37586-c694-41d0-a497-ce96c65fa0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:57.867785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee37586-c694-41d0-a497-ce96c65fa0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:57.867785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee37586-c694-41d0-a497-ce96c65fa0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:57.867785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee37586-c694-41d0-a497-ce96c65fa0e4 None admin] PATH_INFO: `/v3/groups/7d66bf63efd74f8480f6a69946c931ec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:57.869005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee37586-c694-41d0-a497-ce96c65fa0e4 None admin] RBAC: Authorizing `identity:get_group(group_id=7d66bf63efd74f8480f6a69946c931ec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.870447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee37586-c694-41d0-a497-ce96c65fa0e4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.872271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 229/450] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/groups/7d66bf63efd74f8480f6a69946c931ec => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:57.878590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee37586-c694-41d0-a497-ce96c65fa0e4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:57.880292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36719f59-83b2-4039-a23c-fdfc8bc921ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:57.882298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36719f59-83b2-4039-a23c-fdfc8bc921ea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:57.969356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:58.005700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 222/451] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:49:58.007131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36719f59-83b2-4039-a23c-fdfc8bc921ea None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:58.009091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee37586-c694-41d0-a497-ce96c65fa0e4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:58.057988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:58.058566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:58.058854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:58.059133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:58.059895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] RBAC: Adding query filter params (group.id=7d66bf63efd74f8480f6a69946c931ec, role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=165361dc47704cb28d965f63da95703d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:58.060217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:58.061983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:58.069182 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 230/452] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:57 2022] GET /identity/v3/role_assignments?group.id=7d66bf63efd74f8480f6a69946c931ec&scope.project.id=165361dc47704cb28d965f63da95703d&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:58.112256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:58.146362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36719f59-83b2-4039-a23c-fdfc8bc921ea None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:58.191051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f551-957d-4926-8bc5-2a52262230a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:58.191720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f551-957d-4926-8bc5-2a52262230a9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:58.192006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f551-957d-4926-8bc5-2a52262230a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:58.192283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f551-957d-4926-8bc5-2a52262230a9 None admin] PATH_INFO: `/v3/projects/9905c16dd71145d6a307772e4fe88d81` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:58.193823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58f551-957d-4926-8bc5-2a52262230a9 None admin] RBAC: Authorizing `identity:get_project(project_id=9905c16dd71145d6a307772e4fe88d81)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:58.195315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58f551-957d-4926-8bc5-2a52262230a9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:58.197259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 223/453] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:49:58 2022] GET /identity/v3/projects/9905c16dd71145d6a307772e4fe88d81 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:58.203061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:58.319687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98137-283a-498f-914e-a0fd0a058693 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:58.360508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371593ee-a0de-4e5e-a10c-fedaed8c6e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:58.361177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371593ee-a0de-4e5e-a10c-fedaed8c6e30 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:58.361459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371593ee-a0de-4e5e-a10c-fedaed8c6e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:58.361732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371593ee-a0de-4e5e-a10c-fedaed8c6e30 None admin] PATH_INFO: `/v3/groups/7e5958035e4c461cbc8a69edefb3ea56` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:58.362908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371593ee-a0de-4e5e-a10c-fedaed8c6e30 None admin] RBAC: Authorizing `identity:get_group(group_id=7e5958035e4c461cbc8a69edefb3ea56)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:58.364341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371593ee-a0de-4e5e-a10c-fedaed8c6e30 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:58.366011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 231/454] 10.222.0.75 () {56 vars in 1180 bytes} [Mon Sep 19 14:49:58 2022] GET /identity/v3/groups/7e5958035e4c461cbc8a69edefb3ea56 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:49:58.372071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f551-957d-4926-8bc5-2a52262230a9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:58.488270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f551-957d-4926-8bc5-2a52262230a9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:58.525006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861e053-0270-4301-873a-73302fc920cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:58.525620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861e053-0270-4301-873a-73302fc920cf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:58.525905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861e053-0270-4301-873a-73302fc920cf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:58.526185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861e053-0270-4301-873a-73302fc920cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:58.526928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861e053-0270-4301-873a-73302fc920cf None admin] RBAC: Adding query filter params (group.id=7e5958035e4c461cbc8a69edefb3ea56, role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=9905c16dd71145d6a307772e4fe88d81) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:49:58.527240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861e053-0270-4301-873a-73302fc920cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:58.528690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861e053-0270-4301-873a-73302fc920cf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:58.534660 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 224/455] 10.222.0.75 () {56 vars in 1376 bytes} [Mon Sep 19 14:49:58 2022] GET /identity/v3/role_assignments?group.id=7e5958035e4c461cbc8a69edefb3ea56&scope.project.id=9905c16dd71145d6a307772e4fe88d81&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:01.275418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88209-4597-40f6-8db7-ec3d3d2ae54b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.276522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88209-4597-40f6-8db7-ec3d3d2ae54b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.277035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88209-4597-40f6-8db7-ec3d3d2ae54b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.279074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 232/456] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:01.285330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172677-3803-49fe-81e7-f2e3f538efba None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.285850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172677-3803-49fe-81e7-f2e3f538efba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.285850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172677-3803-49fe-81e7-f2e3f538efba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.304367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:01.312126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b9172677-3803-49fe-81e7-f2e3f538efba None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:01.313381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b9172677-3803-49fe-81e7-f2e3f538efba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:01.409186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 225/457] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:01.434867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b0ca2-991b-4210-924b-28cdd94c1856 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.435462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b0ca2-991b-4210-924b-28cdd94c1856 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.435904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b0ca2-991b-4210-924b-28cdd94c1856 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.459038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 233/458] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:01.459180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360a33f-c0d3-4e38-b62b-648ce8a60585 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.459180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360a33f-c0d3-4e38-b62b-648ce8a60585 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.459180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360a33f-c0d3-4e38-b62b-648ce8a60585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.473721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7360a33f-c0d3-4e38-b62b-648ce8a60585 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:01.475526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7360a33f-c0d3-4e38-b62b-648ce8a60585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:01.573851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 226/459] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:01.668543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2dad-3bec-47be-9a0b-1348519c28cf None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.668859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2dad-3bec-47be-9a0b-1348519c28cf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.669113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f2dad-3bec-47be-9a0b-1348519c28cf None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.670693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 234/460] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:01.675896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4baf1-21ee-4415-9569-1ff77113552f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.676190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4baf1-21ee-4415-9569-1ff77113552f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.676470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4baf1-21ee-4415-9569-1ff77113552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.696103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c4a4baf1-21ee-4415-9569-1ff77113552f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:01.697345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c4a4baf1-21ee-4415-9569-1ff77113552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:01.741912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f2dad-3bec-47be-9a0b-1348519c28cf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:01.750681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:01.793954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:01.802896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 227/461] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:01.911909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f2dad-3bec-47be-9a0b-1348519c28cf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:01.960178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:01.960849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.961133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.961409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.977025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:01.978543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:01.996768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:01.997736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:01.998591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:01.998591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:01.998591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:01.998591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 235/462] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:02.004816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4baf1-21ee-4415-9569-1ff77113552f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:02.126027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4baf1-21ee-4415-9569-1ff77113552f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:02.133409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:02.166808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:02.167301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.167584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.167859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.168525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:02.168831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:02.170311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:02.183711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 228/463] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:02.185009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:02.204997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:02.253707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:02.254226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a4b6e-9610-4685-9189-00275945679d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:02.308126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:02.308848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d864b-fd88-48f6-b2c0-743dc552ca39 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:02.310135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.310782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.312129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.327693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:02.330032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:02.349511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:02.350597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:02.351447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:02.351447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:02.351447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:02.356597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 236/464] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:02.357695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:02.365790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:02.366918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.367500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.367973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.383221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:02.385706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:02.403976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:02.404984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:02.405883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:02.405883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:02.405883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:02.410391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 229/465] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:02.412031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:02.485383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb131d-f963-4175-9bc7-254bf69f0ae3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:02.501372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:02.527743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e4cbb-74b4-4449-805c-b4d075bd1b6c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:02.532697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252595f-ab65-4eda-9f4a-d110970b8991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:02.533551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252595f-ab65-4eda-9f4a-d110970b8991 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.533952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252595f-ab65-4eda-9f4a-d110970b8991 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.534363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252595f-ab65-4eda-9f4a-d110970b8991 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.535393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252595f-ab65-4eda-9f4a-d110970b8991 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:02.537282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252595f-ab65-4eda-9f4a-d110970b8991 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:02.538157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:02.562801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:02.563406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.563700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.563960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.564640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:02.564956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:02.566406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:02.578646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 230/466] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:02.579455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:02.702162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd2500-d713-4b30-87a5-79931ce03e49 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:02.735861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b0a2a-e4b0-43dc-a0d3-0e703fa6718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:02.736391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b0a2a-e4b0-43dc-a0d3-0e703fa6718d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.736707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b0a2a-e4b0-43dc-a0d3-0e703fa6718d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.736982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b0a2a-e4b0-43dc-a0d3-0e703fa6718d None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.737662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b0a2a-e4b0-43dc-a0d3-0e703fa6718d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:02.738216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b0a2a-e4b0-43dc-a0d3-0e703fa6718d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:02.740214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b0a2a-e4b0-43dc-a0d3-0e703fa6718d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:02.755780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 231/467] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:02.755780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627568b0-9a62-444d-8d45-511755a57c01 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.755780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627568b0-9a62-444d-8d45-511755a57c01 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.755780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627568b0-9a62-444d-8d45-511755a57c01 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.755780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 232/468] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:02.756884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627568b0-9a62-444d-8d45-511755a57c01 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:02.770912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 237/469] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:50:02 2022] POST /identity/v3/users => generated 246 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:02.770912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53435346-7d4a-4e16-a89c-7b82277aada0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.770912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53435346-7d4a-4e16-a89c-7b82277aada0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.770912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53435346-7d4a-4e16-a89c-7b82277aada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.800891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:02.804013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-53435346-7d4a-4e16-a89c-7b82277aada0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:02.809621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-53435346-7d4a-4e16-a89c-7b82277aada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:02.910617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627568b0-9a62-444d-8d45-511755a57c01 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:02.921691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 238/470] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:02.923198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53435346-7d4a-4e16-a89c-7b82277aada0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:02.973766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5f030-5bd7-41fa-bc97-768f44554320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:02.974609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5f030-5bd7-41fa-bc97-768f44554320 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.975173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5f030-5bd7-41fa-bc97-768f44554320 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.975366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5f030-5bd7-41fa-bc97-768f44554320 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.976101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5f030-5bd7-41fa-bc97-768f44554320 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:02.977630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5f030-5bd7-41fa-bc97-768f44554320 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:03.054438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:03.062020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53435346-7d4a-4e16-a89c-7b82277aada0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:03.100029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7e5a-d659-4901-b4c4-a00312be9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:03.100689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7e5a-d659-4901-b4c4-a00312be9164 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:03.100961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7e5a-d659-4901-b4c4-a00312be9164 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:03.101228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7e5a-d659-4901-b4c4-a00312be9164 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:03.101930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e7e5a-d659-4901-b4c4-a00312be9164 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:03.103405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e7e5a-d659-4901-b4c4-a00312be9164 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:03.160581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 233/471] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:50:02 2022] POST /identity/v3/users => generated 248 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:03.160581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4cc7-96ce-406f-b71e-c364c3570cac None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:03.160581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4cc7-96ce-406f-b71e-c364c3570cac None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:03.160581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4cc7-96ce-406f-b71e-c364c3570cac None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:03.161282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 234/472] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:03.167464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce291a3-0093-4c1b-8ce8-cfc0db9053e1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:03.167777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce291a3-0093-4c1b-8ce8-cfc0db9053e1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:03.168045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce291a3-0093-4c1b-8ce8-cfc0db9053e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:03.192498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5ce291a3-0093-4c1b-8ce8-cfc0db9053e1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:03.193896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5ce291a3-0093-4c1b-8ce8-cfc0db9053e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:03.274509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 235/473] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:50:03.280607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce291a3-0093-4c1b-8ce8-cfc0db9053e1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:03.296515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:03.299795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 239/474] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:50:02 2022] POST /identity/v3/users => generated 248 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:03.421117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce291a3-0093-4c1b-8ce8-cfc0db9053e1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:03.460329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:03.461018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:03.461297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:03.461569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:03.475476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:03.477127 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:03.500735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:03.501773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:03.502631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:03.502631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:03.502631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:03.502631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 236/475] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:03.510879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7e5a-d659-4901-b4c4-a00312be9164 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:03.636178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:03.670661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7e5a-d659-4901-b4c4-a00312be9164 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:03.719488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:03.720062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:03.720364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:03.720645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:03.721749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:03.722058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:03.723985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:03.741255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 240/476] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:03.747198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:03.762642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:03.765083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:03.907648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac4f2-7d76-4f09-8607-9a1b3f4d5a98 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:03.912275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86328aa6-585d-40e8-be11-e53ddd9957f0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:04.006876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851ed09-b003-4209-8bc7-9bcec8120287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:04.007581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ed09-b003-4209-8bc7-9bcec8120287 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:04.008723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ed09-b003-4209-8bc7-9bcec8120287 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:04.008723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ed09-b003-4209-8bc7-9bcec8120287 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:04.009166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851ed09-b003-4209-8bc7-9bcec8120287 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:04.010732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851ed09-b003-4209-8bc7-9bcec8120287 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:04.028935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:04.028935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:04.028935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:04.028935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:04.033469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:04.036829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:04.101338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.sql.core [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:50:04.101338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 14:50:04.101338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [parameters: {'id': '4ee4381d58f8456592829d65f416edcf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 14:50:04.101338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81643) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 19 14:50:04.122229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:50:04.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application yield resource Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise self.value Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application session.commit() Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:50:04.124089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:50:04.125002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:50:04.130966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:50:04.133015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [parameters: {'id': '4ee4381d58f8456592829d65f416edcf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:04.134915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 14:50:04.136857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:04.146437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 237/477] 10.222.0.75 () {60 vars in 1131 bytes} [Mon Sep 19 14:50:03 2022] POST /identity/v3/roles => generated 144 bytes in 488 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:04.146437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:04.155319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 241/478] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:50:03 2022] POST /identity/v3/users => generated 249 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:04.328106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde9fd6-61b1-4ea6-9e67-352597f8ed5c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:04.366955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:04.372747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e96e3-9a23-4791-85f1-b347a84edbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:04.373405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e96e3-9a23-4791-85f1-b347a84edbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:04.373691 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e96e3-9a23-4791-85f1-b347a84edbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:04.373966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e96e3-9a23-4791-85f1-b347a84edbf5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:04.387474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e96e3-9a23-4791-85f1-b347a84edbf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-8f8e96e3-9a23-4791-85f1-b347a84edbf5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:04.397713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:04.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:04.399482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 238/479] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:04.405281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851ed09-b003-4209-8bc7-9bcec8120287 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:04.481255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:04.523941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851ed09-b003-4209-8bc7-9bcec8120287 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:04.563065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546a8ed-b56d-4964-9b48-8286173945e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:04.563689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546a8ed-b56d-4964-9b48-8286173945e3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:04.563971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546a8ed-b56d-4964-9b48-8286173945e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:04.564245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546a8ed-b56d-4964-9b48-8286173945e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:04.564955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546a8ed-b56d-4964-9b48-8286173945e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:04.565255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546a8ed-b56d-4964-9b48-8286173945e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:04.566623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546a8ed-b56d-4964-9b48-8286173945e3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:04.575668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 242/480] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:05.520847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6269b7-768e-4ac7-952d-72d391f2a477 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:05.521828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6269b7-768e-4ac7-952d-72d391f2a477 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:05.522387 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6269b7-768e-4ac7-952d-72d391f2a477 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:05.524299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 239/481] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:05.529702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b76cb-607b-4c3e-88bc-5b7272ba9cd2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:05.530663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b76cb-607b-4c3e-88bc-5b7272ba9cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:05.531144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b76cb-607b-4c3e-88bc-5b7272ba9cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:05.558525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9d5b76cb-607b-4c3e-88bc-5b7272ba9cd2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:05.560083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9d5b76cb-607b-4c3e-88bc-5b7272ba9cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:05.659772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 243/482] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:06.144032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8be62e-5e16-4c5e-b978-3d6c0b983558 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.144761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8be62e-5e16-4c5e-b978-3d6c0b983558 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.145315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8be62e-5e16-4c5e-b978-3d6c0b983558 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.147886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 240/483] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:06.153283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966b1a-1992-472b-bc13-614ccae2fc01 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.153851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966b1a-1992-472b-bc13-614ccae2fc01 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.154328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966b1a-1992-472b-bc13-614ccae2fc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.173848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-eb966b1a-1992-472b-bc13-614ccae2fc01 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:06.175404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eb966b1a-1992-472b-bc13-614ccae2fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:06.175556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d76f-316c-44c9-8365-7e05d443d9ce None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.175764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d76f-316c-44c9-8365-7e05d443d9ce None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.175982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d76f-316c-44c9-8365-7e05d443d9ce None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.177670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 241/484] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:06.182951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806a6e6-9863-49ae-aa99-1eddca67f827 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.183205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806a6e6-9863-49ae-aa99-1eddca67f827 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.183483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806a6e6-9863-49ae-aa99-1eddca67f827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.214310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d806a6e6-9863-49ae-aa99-1eddca67f827 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:06.215525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d806a6e6-9863-49ae-aa99-1eddca67f827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:06.272509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:06.273107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 244/485] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:06.274574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb966b1a-1992-472b-bc13-614ccae2fc01 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:06.312507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 242/486] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:50:06.425729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb966b1a-1992-472b-bc13-614ccae2fc01 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:06.463533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cdfcf-388e-42c3-979b-1329a10e3985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:06.464188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cdfcf-388e-42c3-979b-1329a10e3985 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.464459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cdfcf-388e-42c3-979b-1329a10e3985 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.464756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cdfcf-388e-42c3-979b-1329a10e3985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.483494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cdfcf-388e-42c3-979b-1329a10e3985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1a9cdfcf-388e-42c3-979b-1329a10e3985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:06.490421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:06.492165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:06.494276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:06.500160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 245/487] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:06.504645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806a6e6-9863-49ae-aa99-1eddca67f827 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:06.572042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cdfcf-388e-42c3-979b-1329a10e3985 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:06.666725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:06.698842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806a6e6-9863-49ae-aa99-1eddca67f827 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:06.715384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cdfcf-388e-42c3-979b-1329a10e3985 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:06.759611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:06.764375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007c6ff-035b-40fa-910c-3c815db8d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:06.765724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c6ff-035b-40fa-910c-3c815db8d397 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.766484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c6ff-035b-40fa-910c-3c815db8d397 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.766994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007c6ff-035b-40fa-910c-3c815db8d397 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.775486 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:06.776145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.776430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.776777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.777621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:06.777930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:06.779582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:06.790046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007c6ff-035b-40fa-910c-3c815db8d397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:06.795314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 243/488] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:06.795314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c007c6ff-035b-40fa-910c-3c815db8d397 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:06.801606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:06.802561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:06.803517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:06.806443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 246/489] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:06.807481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007c6ff-035b-40fa-910c-3c815db8d397 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:06.929143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0d0a-ba18-410b-8779-01eed51ad75f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:06.955883 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007c6ff-035b-40fa-910c-3c815db8d397 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:06.968423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87b9d7-76b0-4e46-b9d0-f0510f2efd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:06.969228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b9d7-76b0-4e46-b9d0-f0510f2efd50 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:06.969701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b9d7-76b0-4e46-b9d0-f0510f2efd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:06.970141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b9d7-76b0-4e46-b9d0-f0510f2efd50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:06.970965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:06.984272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87b9d7-76b0-4e46-b9d0-f0510f2efd50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ec87b9d7-76b0-4e46-b9d0-f0510f2efd50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:06.996701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:06.997702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 244/490] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:06.998508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87b9d7-76b0-4e46-b9d0-f0510f2efd50 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.010798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.011449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.011730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.012007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.026015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.027844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:07.043756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:07.044778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:07.045636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:07.045636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:07.045636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:07.045636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 247/491] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:07.045858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.052239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.124456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87b9d7-76b0-4e46-b9d0-f0510f2efd50 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:07.165884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc222-1f19-436d-a96a-a07d3abb5f0b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:07.167150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e13708-e7cb-4b09-968f-434c7a07622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.168177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13708-e7cb-4b09-968f-434c7a07622c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.168695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13708-e7cb-4b09-968f-434c7a07622c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.169166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13708-e7cb-4b09-968f-434c7a07622c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.170174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e13708-e7cb-4b09-968f-434c7a07622c None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:07.170558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e13708-e7cb-4b09-968f-434c7a07622c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.172401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e13708-e7cb-4b09-968f-434c7a07622c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.188181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 245/492] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:07.189676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c971-6b59-4fe3-8f3f-a420c8a4da8f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.189970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c971-6b59-4fe3-8f3f-a420c8a4da8f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.190252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c971-6b59-4fe3-8f3f-a420c8a4da8f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.196425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 246/493] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:07.196425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422c971-6b59-4fe3-8f3f-a420c8a4da8f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.213462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.214018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.214310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.214588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.215266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:07.215567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.217001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.225686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 248/494] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:07.226517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.259759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.317247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422c971-6b59-4fe3-8f3f-a420c8a4da8f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:07.320628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.351177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690c4b8-488c-48ba-b734-2cf4432d34f7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:07.357332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5351f-fcbe-4200-ab97-5d62568eea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.358291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5351f-fcbe-4200-ab97-5d62568eea84 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.358947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5351f-fcbe-4200-ab97-5d62568eea84 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.359479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5351f-fcbe-4200-ab97-5d62568eea84 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.360608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5351f-fcbe-4200-ab97-5d62568eea84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:07.360921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5351f-fcbe-4200-ab97-5d62568eea84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.362319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5351f-fcbe-4200-ab97-5d62568eea84 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.383508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 247/495] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:07.383508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b654-1db9-432d-9f98-d4e6e50af29d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.383508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b654-1db9-432d-9f98-d4e6e50af29d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.383508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6b654-1db9-432d-9f98-d4e6e50af29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.393275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.393933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.394198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.394478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.401182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fec6b654-1db9-432d-9f98-d4e6e50af29d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:07.402410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fec6b654-1db9-432d-9f98-d4e6e50af29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:07.407167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.408659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:07.425266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:07.426263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:07.427668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:07.427668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:07.427668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:07.427668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 249/496] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:07.428829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.482648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 248/497] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:07.483492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b654-1db9-432d-9f98-d4e6e50af29d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.582150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.611202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a3ab7-0bc3-40d5-99c2-9f9d2b524cad None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:07.649202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.653722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.654340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.654624 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.654900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.658190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6b654-1db9-432d-9f98-d4e6e50af29d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:07.666275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.667740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:07.683553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:07.684691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:07.690543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:07.690543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:07.690543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:07.690543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 250/498] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:07.690543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.704578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef28dd9-8960-4fb5-9975-70d95d542939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.705229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28dd9-8960-4fb5-9975-70d95d542939 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.705989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28dd9-8960-4fb5-9975-70d95d542939 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.706239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28dd9-8960-4fb5-9975-70d95d542939 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.714738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef28dd9-8960-4fb5-9975-70d95d542939 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.716200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef28dd9-8960-4fb5-9975-70d95d542939 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0ef28dd9-8960-4fb5-9975-70d95d542939 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:07.730876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:07.731829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:07.732870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 249/499] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:07.733493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0acf63-ae5e-46bf-a930-ee1b19b50897 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.733493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0acf63-ae5e-46bf-a930-ee1b19b50897 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.734623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0acf63-ae5e-46bf-a930-ee1b19b50897 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.739133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 250/500] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:07.740730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0acf63-ae5e-46bf-a930-ee1b19b50897 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.816040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba89919-06ce-42dc-b92d-93d98ea044fe None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:07.852183 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.856042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0acf63-ae5e-46bf-a930-ee1b19b50897 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:07.861121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.861731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.862011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.862282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.863072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:07.863358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.865427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.878134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 251/501] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:07.879194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.897143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9083ca-2fda-4509-8160-e29c3bc3027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:07.897759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9083ca-2fda-4509-8160-e29c3bc3027e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.898045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9083ca-2fda-4509-8160-e29c3bc3027e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.898316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9083ca-2fda-4509-8160-e29c3bc3027e None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.898974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9083ca-2fda-4509-8160-e29c3bc3027e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:07.899281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9083ca-2fda-4509-8160-e29c3bc3027e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:07.900747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9083ca-2fda-4509-8160-e29c3bc3027e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:07.915232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 251/502] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:07.916763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f50b-e656-4788-aac8-f73a22233c51 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.917178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f50b-e656-4788-aac8-f73a22233c51 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.917485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f50b-e656-4788-aac8-f73a22233c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.936617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7aa4f50b-e656-4788-aac8-f73a22233c51 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:07.937831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7aa4f50b-e656-4788-aac8-f73a22233c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:07.949252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:07.996068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a98e6-f87d-40eb-b1f1-f666e00c869d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.011897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 252/503] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:08.012768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4f50b-e656-4788-aac8-f73a22233c51 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.037550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.038715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.038995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.039278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.040022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:08.040320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.041793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.082271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 252/504] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:08.083624 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.132508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4f50b-e656-4788-aac8-f73a22233c51 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.139170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.177667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa72ff-d375-480b-938a-bc4412016fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.178943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa72ff-d375-480b-938a-bc4412016fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.179370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa72ff-d375-480b-938a-bc4412016fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.179880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa72ff-d375-480b-938a-bc4412016fe3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.198233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa72ff-d375-480b-938a-bc4412016fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a3aa72ff-d375-480b-938a-bc4412016fe3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:08.203206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:08.204151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 253/505] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:08.211207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa72ff-d375-480b-938a-bc4412016fe3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.213639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.219238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf23987-d81f-406e-b1a8-2bd3a261d75e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.261987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.262539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.262824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.263100 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.271300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.273282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:08.288135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:08.289147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:08.290031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 253/506] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:08.290592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.322895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa72ff-d375-480b-938a-bc4412016fe3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.358403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.359039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.359323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.359601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.367171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.368693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:08.381460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:08.382550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 254/507] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:08.383964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.413336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582fa0-c9ce-47e4-b4b0-d48ce87567f5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.415924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.447788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed40b6-04ea-4403-9b9b-4d218ebd3f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.448424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed40b6-04ea-4403-9b9b-4d218ebd3f72 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.448744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed40b6-04ea-4403-9b9b-4d218ebd3f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.449017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed40b6-04ea-4403-9b9b-4d218ebd3f72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.449924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.497473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e791cd-1255-4f51-b4dd-148ca9d8919f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.527817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed40b6-04ea-4403-9b9b-4d218ebd3f72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.529299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed40b6-04ea-4403-9b9b-4d218ebd3f72 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.534485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.535148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.535428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.535747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.537055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:08.537379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.538773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.547759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 255/508] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:08.548610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.649751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 254/509] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:08.650617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed40b6-04ea-4403-9b9b-4d218ebd3f72 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.653750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.671857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3eb3ee-76c6-42b8-9c3a-58f3d5ff1c82 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.700550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.713647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.715043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.715295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.715545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.727349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.728860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:08.743394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:08.744366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:08.745241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:08.745241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:08.745241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:08.745241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 256/510] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:08.745465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.764513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed40b6-04ea-4403-9b9b-4d218ebd3f72 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.806075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.806610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.806896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.807172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.807909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:08.808216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.809719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.828969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 255/511] 10.222.0.75 () {56 vars in 1137 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:08.829815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.858874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f983-533a-4da3-8980-1c5e8fa396c4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.892438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.893337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.893931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.894208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.894483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.895207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:08.896068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.897742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.932071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b008f-3564-4e10-bcd7-3d52090c283b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.935017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 257/512] 10.222.0.75 () {56 vars in 1137 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:08.935862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:08.969597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.970221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.970500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.970766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.973070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.981968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.983425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:08.998441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:08.999712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:09.000685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:09.000685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:09.000685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:09.000685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 256/513] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:09.000897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.051679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237e854-237d-477f-beac-9e743fc34e63 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:09.088009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:09.088685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:09.088973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:09.089253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:09.100314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:09.101846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:09.108266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18943bb-70d3-4488-86b6-2d65898a9f49 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:09.116725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:09.117663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:09.118488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:09.118488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:09.118488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:09.118488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 258/514] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:09.118708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.124268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.146702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:09.147386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:09.147666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:09.147950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:09.148622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:09.148930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:09.150592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:09.162149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 257/515] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:09.162989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.227926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.240011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d37bb-5199-4f3c-b286-8c49c394163c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:09.275458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee7453-4da0-444f-b719-559521af9273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:09.276068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee7453-4da0-444f-b719-559521af9273 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:09.276345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee7453-4da0-444f-b719-559521af9273 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:09.276643 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee7453-4da0-444f-b719-559521af9273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:09.279595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d9bd9-5b17-4989-8a86-73386f324e79 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:09.314367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad9b7-05a6-48f6-9236-e4215c0c37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:09.315114 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad9b7-05a6-48f6-9236-e4215c0c37ea None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:09.315455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad9b7-05a6-48f6-9236-e4215c0c37ea None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:09.315762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad9b7-05a6-48f6-9236-e4215c0c37ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:09.356217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee7453-4da0-444f-b719-559521af9273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:09.357664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee7453-4da0-444f-b719-559521af9273 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:09.366966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.393944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fad9b7-05a6-48f6-9236-e4215c0c37ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:09.395519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fad9b7-05a6-48f6-9236-e4215c0c37ea None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:09.457830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.472519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 259/516] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:09.473836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee7453-4da0-444f-b719-559521af9273 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.505900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 258/517] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:09.507184 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad9b7-05a6-48f6-9236-e4215c0c37ea None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.585405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.588431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee7453-4da0-444f-b719-559521af9273 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:09.612805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad9b7-05a6-48f6-9236-e4215c0c37ea None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:09.627606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:09.628216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:09.628530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:09.628809 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:09.629461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:09.629766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:09.631984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:09.643370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 260/518] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:09.645337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.648818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:09.649435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:09.649716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:09.649989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:09.650631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:09.650933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:09.652284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:09.669656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 259/519] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:09.669656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.699968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.760549 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cdfd2-11b8-4108-977c-1cb63984e897 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:09.784706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a12345-bfab-47f4-90c7-5ce9ede30dd1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:09.796472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a881-4929-442a-bd1c-e4b2a94ba25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:09.797137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a881-4929-442a-bd1c-e4b2a94ba25c None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:09.797412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a881-4929-442a-bd1c-e4b2a94ba25c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:09.797680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a881-4929-442a-bd1c-e4b2a94ba25c None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:09.798320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115a881-4929-442a-bd1c-e4b2a94ba25c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:09.799806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115a881-4929-442a-bd1c-e4b2a94ba25c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:09.822963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:09.823597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:09.823878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:09.827031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:09.827031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:09.837239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:09.838700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:09.854209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:09.855358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:09.856618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:09.856618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:09.856618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:09.856618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 260/520] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:09.856618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.919089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 261/521] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:50:09 2022] POST /identity/v3/users => generated 247 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:09.919869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a881-4929-442a-bd1c-e4b2a94ba25c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:09.983228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7e10e-edb8-4052-beba-750279f0d9eb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.031720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.032675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.032675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.032953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.044979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.046493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.050089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a881-4929-442a-bd1c-e4b2a94ba25c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.053859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:10.062925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:10.085244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:10.086221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:10.086221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:10.086221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:10.086221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 261/522] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:10.086221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.101534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.102374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.102653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.102926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.111683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.113920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.117606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:10.128947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:10.133511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 262/523] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:10.134538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.195697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261e169-4cff-4446-b9c4-0f91f6b96149 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.233549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.234202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.234483 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.234762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.242741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.244207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:10.257973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:10.259007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:10.259851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 262/524] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:10.260339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242f14-e0f6-4e65-96b5-ff8e5a396472 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.264411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.300631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.301245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.301520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.302350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.303005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:10.303308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.304755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.323573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 263/525] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:10.323573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.351187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.384648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.388456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561adb3-d123-4726-a288-e44d5f2c29eb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.424435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.425270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.426060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.426682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.427955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:10.428840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.430229 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.444114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925bfb4-d1e7-4773-ab98-79f4854e106d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.450018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 263/526] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:10.450960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.488264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.488625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.488942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.489192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.490605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:10.490921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.492393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.513919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 264/527] 10.222.0.75 () {56 vars in 1139 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:10.514792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.591007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fdc1f-07ed-4c38-8902-f2f245c54091 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.619324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.630903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.631526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.631806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.636278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.636278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:10.636278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.636278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.639286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e54d80-c49d-4e04-94f9-a6c0cd901ba4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.653747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 264/528] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:10.655857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.675897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.676448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.678028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.678620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.680011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.686539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.688029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:10.700683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:10.701540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:10.702395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 265/529] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:10.702877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.784671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f8885-398c-4f8b-8c62-da3f04f2bd36 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.813979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704f043-6413-438b-b50e-92e61e3ec27c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:10.825058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.825741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.825977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.826245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.833194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.843830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.853545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b04b95-695f-4eb4-bf8b-c7a668cd683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:10.854519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b04b95-695f-4eb4-bf8b-c7a668cd683f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.854975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b04b95-695f-4eb4-bf8b-c7a668cd683f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.855418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b04b95-695f-4eb4-bf8b-c7a668cd683f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:10.857389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:10.858239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:10.859067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:10.859067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:10.859067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:10.859067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:10.859067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:10.859067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:10.859067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:10.859067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:10.863184 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 265/530] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:10.864081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:10.871654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.936092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b04b95-695f-4eb4-bf8b-c7a668cd683f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:10.937604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b04b95-695f-4eb4-bf8b-c7a668cd683f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:10.956407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.982402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a28b9-81f9-4d3f-9031-4f41110ad47a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.018242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.019238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.019747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.020236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.021950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ab4bb702760a4cd2b2cbf6f732b2360b) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:11.022363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.024216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.040512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 266/531] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/role_assignments?user.id=ab4bb702760a4cd2b2cbf6f732b2360b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:11.040512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.068984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 266/532] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:11.069914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b04b95-695f-4eb4-bf8b-c7a668cd683f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.137121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:11.190349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d052c22-e13b-4666-ac9b-54e83287d7cd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.236248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b04b95-695f-4eb4-bf8b-c7a668cd683f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.242035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.242788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.243672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.243672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.244432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:11.244859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.246416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.263696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 267/533] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:11.264823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.268396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:11.291950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.292842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.293303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.293727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.294595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:11.295063 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.296673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.320517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 267/534] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:11.321752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.376672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f471b-d1bd-4724-b8ff-1fa805356f05 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.417684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.432996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.432996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.432996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.434306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.435912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.436701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df8c6-c896-40df-a0de-af9ae778b765 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.438325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:11.457534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:11.459206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:11.460239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:11.460239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:11.460239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:11.466944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 268/535] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:11.466944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.489090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.490067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.490524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.491499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.492735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=a203084e8c5d4cb6b258b2d39db4f9dd) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:11.493200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.495491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.504026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 268/536] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/role_assignments?user.id=a203084e8c5d4cb6b258b2d39db4f9dd&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:11.505903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.564424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:11.671279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d7c4-dc9b-4c24-84ab-42bf1bf28a1d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.707492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408da82-dc08-4c4c-99ee-d20437cf93d3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.746796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.747347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.747635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.747918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.756516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=aa1d30decad84c7081c7e150812b2964) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:11.756516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.756516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.757917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 269/537] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/role_assignments?user.id=aa1d30decad84c7081c7e150812b2964&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:11.790573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.791235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.791551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.791839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.792662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:11.792980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.794453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.811361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 269/538] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:11.817269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.978052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ef1b-65e6-41f7-8f73-cdeead635d88 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.998345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:12.018749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:12.019394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:12.019678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:12.019960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:12.028920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:12.030409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:12.043898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:12.044818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:12.046257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 270/539] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:12.051371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:12.120401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:12.230516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c1659-1eb0-42d7-8944-aad3d76d360a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:12.293466 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9a9af-8326-4c4d-9ab5-450701d8cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:12.293987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a9af-8326-4c4d-9ab5-450701d8cb7d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:12.294266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a9af-8326-4c4d-9ab5-450701d8cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:12.294536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a9af-8326-4c4d-9ab5-450701d8cb7d None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:12.295257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9a9af-8326-4c4d-9ab5-450701d8cb7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:12.295584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9a9af-8326-4c4d-9ab5-450701d8cb7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:12.297188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9a9af-8326-4c4d-9ab5-450701d8cb7d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:12.310626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 270/540] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:12.316308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:12.440309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3908b-61e9-4b7e-9440-ad1b61d44d69 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:12.485999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a22db-c2d0-4b2a-a8f4-cb66d99b5d3b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:12.486509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a22db-c2d0-4b2a-a8f4-cb66d99b5d3b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:12.487033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a22db-c2d0-4b2a-a8f4-cb66d99b5d3b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:12.491730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 271/541] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:12.497204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a670f-37e3-4de9-bd5f-7620a43bc246 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:12.497204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a670f-37e3-4de9-bd5f-7620a43bc246 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:12.497408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a670f-37e3-4de9-bd5f-7620a43bc246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:12.522956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-050a670f-37e3-4de9-bd5f-7620a43bc246 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:12.524463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-050a670f-37e3-4de9-bd5f-7620a43bc246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:12.527172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:12.527787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:12.528112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:12.528390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:12.529330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=67d0bbf089504d408db0bb7055a780a6) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:12.529643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:12.531080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:12.546558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 271/542] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:12 2022] GET /identity/v3/role_assignments?user.id=67d0bbf089504d408db0bb7055a780a6&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:12.633906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 272/543] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:50:12.950904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:13.010361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:13.092457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01f0d2-cf5e-459b-932a-d47fc10894ac None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:13.141404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf3466-23cd-483a-8bf0-ce430a0fdd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:13.142052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3466-23cd-483a-8bf0-ce430a0fdd66 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.142337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3466-23cd-483a-8bf0-ce430a0fdd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.142613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3466-23cd-483a-8bf0-ce430a0fdd66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.164782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf3466-23cd-483a-8bf0-ce430a0fdd66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9bcf3466-23cd-483a-8bf0-ce430a0fdd66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:13.170161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:13.171041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:13.171827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 272/544] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:13.179407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a670f-37e3-4de9-bd5f-7620a43bc246 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:13.213848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:13.344468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a670f-37e3-4de9-bd5f-7620a43bc246 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:13.395836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:13.396966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.397452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.397938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.398923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:13.399485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:13.401246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:13.411754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 273/545] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:13.418065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf3466-23cd-483a-8bf0-ce430a0fdd66 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:13.578739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf3466-23cd-483a-8bf0-ce430a0fdd66 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:13.580370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:13.634070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d214207-1c28-46b7-aae4-62b99d0e6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:13.634739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d214207-1c28-46b7-aae4-62b99d0e6f08 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.635021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d214207-1c28-46b7-aae4-62b99d0e6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.635296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d214207-1c28-46b7-aae4-62b99d0e6f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.653103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d214207-1c28-46b7-aae4-62b99d0e6f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:13.654575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d214207-1c28-46b7-aae4-62b99d0e6f08 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9d214207-1c28-46b7-aae4-62b99d0e6f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:13.673921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:13.675290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:13.676412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:13.676412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:13.676412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:13.676412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 273/546] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:13.683751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:13.753611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f3f6-42cc-4425-a1b5-83ee88a2c5d2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.753928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f3f6-42cc-4425-a1b5-83ee88a2c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.754265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f3f6-42cc-4425-a1b5-83ee88a2c5d2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.756611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 274/547] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:13.764508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ad14f-b7a4-487f-a639-e952ae3dc1e6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.764508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ad14f-b7a4-487f-a639-e952ae3dc1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.764508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ad14f-b7a4-487f-a639-e952ae3dc1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.782519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-314ad14f-b7a4-487f-a639-e952ae3dc1e6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:13.783995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-314ad14f-b7a4-487f-a639-e952ae3dc1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:13.852976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:13.859916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 275/548] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:50:13.878429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dd962-7524-4054-bf91-7f1c45a44dd6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:13.926173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:13.928032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.928553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.929031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.929903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:13.930422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:13.932012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:13.950410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 274/549] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:13.956008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ad14f-b7a4-487f-a639-e952ae3dc1e6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.057312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.075059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ad14f-b7a4-487f-a639-e952ae3dc1e6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:14.112548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:14.113691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.114431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.114923 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.123062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:14.124842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:14.139884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:14.140943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:14.141973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:14.144504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 276/550] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:14.153648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.251223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.328509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a456e78-8263-46d3-9e7e-b91307252da1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:14.379080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deda990-94b9-4e52-b0e5-d60000cb55bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:14.379628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda990-94b9-4e52-b0e5-d60000cb55bd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.380213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda990-94b9-4e52-b0e5-d60000cb55bd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.380635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda990-94b9-4e52-b0e5-d60000cb55bd None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.381396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deda990-94b9-4e52-b0e5-d60000cb55bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:14.381710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deda990-94b9-4e52-b0e5-d60000cb55bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:14.383287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deda990-94b9-4e52-b0e5-d60000cb55bd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:14.392333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.398051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb44921-2450-455b-b217-1fb688fc4945 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:14.405379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 275/551] 10.222.0.75 () {56 vars in 1135 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:14.411839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2aadb-afc9-4d15-a3df-f752b6b99e7f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.412397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2aadb-afc9-4d15-a3df-f752b6b99e7f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.412740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2aadb-afc9-4d15-a3df-f752b6b99e7f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.414453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 276/552] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:14.415213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2aadb-afc9-4d15-a3df-f752b6b99e7f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.437921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45824cd-6992-4347-8840-ab5d53b3bb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:14.439407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45824cd-6992-4347-8840-ab5d53b3bb1c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.439687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45824cd-6992-4347-8840-ab5d53b3bb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.439963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45824cd-6992-4347-8840-ab5d53b3bb1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.454529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45824cd-6992-4347-8840-ab5d53b3bb1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e45824cd-6992-4347-8840-ab5d53b3bb1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:14.459748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:14.461021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:14.462263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 277/553] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:14.467609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f32b-4bc2-4da1-831f-35aa80c83945 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.467970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f32b-4bc2-4da1-831f-35aa80c83945 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.468176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f32b-4bc2-4da1-831f-35aa80c83945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.477770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.490327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4844f32b-4bc2-4da1-831f-35aa80c83945 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:14.491531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4844f32b-4bc2-4da1-831f-35aa80c83945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:14.531111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2aadb-afc9-4d15-a3df-f752b6b99e7f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:14.568840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 278/554] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:14.569814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f32b-4bc2-4da1-831f-35aa80c83945 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.580247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c741f6-23e5-40e2-b652-e54d5c1acf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:14.581755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c741f6-23e5-40e2-b652-e54d5c1acf9a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.582288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c741f6-23e5-40e2-b652-e54d5c1acf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.582631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c741f6-23e5-40e2-b652-e54d5c1acf9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.673358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.681376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c741f6-23e5-40e2-b652-e54d5c1acf9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:14.683118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c741f6-23e5-40e2-b652-e54d5c1acf9a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:14.694284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f32b-4bc2-4da1-831f-35aa80c83945 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:14.731772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3332a4-fb41-46c2-97de-1a21e1bac85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:14.732384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3332a4-fb41-46c2-97de-1a21e1bac85e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.732703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3332a4-fb41-46c2-97de-1a21e1bac85e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.733034 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3332a4-fb41-46c2-97de-1a21e1bac85e None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.733694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3332a4-fb41-46c2-97de-1a21e1bac85e None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:14.734043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3332a4-fb41-46c2-97de-1a21e1bac85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:14.735396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3332a4-fb41-46c2-97de-1a21e1bac85e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:14.736712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.748836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 279/555] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:14.748836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5083-1c72-4344-b53c-2a4e36690d54 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.748836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5083-1c72-4344-b53c-2a4e36690d54 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.748836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5083-1c72-4344-b53c-2a4e36690d54 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.748836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 280/556] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:14.749733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5083-1c72-4344-b53c-2a4e36690d54 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.803586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 277/557] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:14.805294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533226-6d0a-4b2a-8dc5-8a023d3721fa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.805789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533226-6d0a-4b2a-8dc5-8a023d3721fa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.806263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533226-6d0a-4b2a-8dc5-8a023d3721fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.825319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5f533226-6d0a-4b2a-8dc5-8a023d3721fa None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:14.826853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5f533226-6d0a-4b2a-8dc5-8a023d3721fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:14.860278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5083-1c72-4344-b53c-2a4e36690d54 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:14.902527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:14.902974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 278/558] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:14.903824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f533226-6d0a-4b2a-8dc5-8a023d3721fa None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.905071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.905555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.906035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.918063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:14.919614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:14.934648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:14.935585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:14.936471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:14.936471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:14.936471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:14.940358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 281/559] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:14.941209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.973159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.993866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:15.037271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f533226-6d0a-4b2a-8dc5-8a023d3721fa None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.054115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6e4a2-4adb-492e-8975-0c3b9dfc4a13 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.081889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.082892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.083595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.083953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.095682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.097273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.102813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f3f1-0661-4c66-9fea-1951486d549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.103700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f3f1-0661-4c66-9fea-1951486d549a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.104159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f3f1-0661-4c66-9fea-1951486d549a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.104733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f3f1-0661-4c66-9fea-1951486d549a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:15.113262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:15.114280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:15.115172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:15.115172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:15.115172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:15.115172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 279/560] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:15.115983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.121530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633f3f1-0661-4c66-9fea-1951486d549a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f633f3f1-0661-4c66-9fea-1951486d549a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:15.128608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:15.130425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:15.131449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:15.134750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 282/561] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:15.135768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f3f1-0661-4c66-9fea-1951486d549a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.214920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:15.237070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3043d3-8d2a-4fa6-90d4-8493ca7bb6ac None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.268371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f3f1-0661-4c66-9fea-1951486d549a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.279756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:15.280316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.282232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.282515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.282812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.283476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:15.283780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.285672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.302461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 280/562] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:15.302461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.312527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.313112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.313391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.313660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.314305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:15.314596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.316215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.334285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 283/563] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:15.334285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.418552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df426aa-f417-48ee-ae4e-22d41c54b539 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.450580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b868fa4-dc2c-4ac7-b03d-1c8f21681842 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.456265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.456911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.457202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.457477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.458188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:15.458494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.459874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.466887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:15.469467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 281/564] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:15.470088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.492118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5475a-5653-4d42-99ac-b7a1f589dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.492790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5475a-5653-4d42-99ac-b7a1f589dddc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.493067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5475a-5653-4d42-99ac-b7a1f589dddc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.493396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5475a-5653-4d42-99ac-b7a1f589dddc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.503498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5475a-5653-4d42-99ac-b7a1f589dddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-bac5475a-5653-4d42-99ac-b7a1f589dddc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:15.509725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:15.510782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 284/565] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:15.511900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5475a-5653-4d42-99ac-b7a1f589dddc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.539404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:15.610678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5475a-5653-4d42-99ac-b7a1f589dddc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.631928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747a500-e13f-421b-a675-7fcc1da88ff9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.646312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.646942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.647224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.647498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.654404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.655874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:15.667388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:15.668404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 285/566] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:15.669347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.671861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b339ee-0d3c-403c-bc06-4cd1f22af9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.672512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b339ee-0d3c-403c-bc06-4cd1f22af9cf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.672798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b339ee-0d3c-403c-bc06-4cd1f22af9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.673070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b339ee-0d3c-403c-bc06-4cd1f22af9cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.685441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b339ee-0d3c-403c-bc06-4cd1f22af9cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.686901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b339ee-0d3c-403c-bc06-4cd1f22af9cf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-64b339ee-0d3c-403c-bc06-4cd1f22af9cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:15.699113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:15.700296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:15.701672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 282/567] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:15.702426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bae93-4fe2-4815-8ca4-71f001b41233 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.702426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bae93-4fe2-4815-8ca4-71f001b41233 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.702426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bae93-4fe2-4815-8ca4-71f001b41233 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.703532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 283/568] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:15.704217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bae93-4fe2-4815-8ca4-71f001b41233 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.767229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:15.793181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:15.793181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1d295-bb4b-4e17-91b0-308a803d3058 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.810126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bae93-4fe2-4815-8ca4-71f001b41233 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.823828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.824651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.825306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.825589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.837435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.838943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.844891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.845499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.845786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.846062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.846730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:15.847038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.848391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:15.853692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:15.854614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:15.855475 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:15.855475 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:15.855475 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:15.855828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 286/569] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:15.856955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.857308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 284/570] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:15.858011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:15.957582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1dbd4-fcaa-4d1b-a97d-ba8a70ab5493 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.961285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4a42-79e8-46b1-b47b-d035102cb3ff None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:15.980766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:15.992826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.993514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.993821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.994098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.994836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:15.995141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:15.996625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:15.996735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599882d-c0c9-488a-98b5-d399ea1415c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:15.997354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599882d-c0c9-488a-98b5-d399ea1415c9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:15.997690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599882d-c0c9-488a-98b5-d399ea1415c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:15.998021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599882d-c0c9-488a-98b5-d399ea1415c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:15.998771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599882d-c0c9-488a-98b5-d399ea1415c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:15.999289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599882d-c0c9-488a-98b5-d399ea1415c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.000661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599882d-c0c9-488a-98b5-d399ea1415c9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:16.010313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:16.013825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 287/571] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:16.015116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cebb-f316-48d6-aa1f-4958855fc98c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.021977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cebb-f316-48d6-aa1f-4958855fc98c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.022132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 285/572] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:50:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:16.022219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cebb-f316-48d6-aa1f-4958855fc98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.022293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.034393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7309cebb-f316-48d6-aa1f-4958855fc98c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:16.035605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7309cebb-f316-48d6-aa1f-4958855fc98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:16.104290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 288/573] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:16.105391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cebb-f316-48d6-aa1f-4958855fc98c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.137536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a153d-1c7e-4f3e-8ed1-7feabf132f76 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.173862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.174554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.174835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.175109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.175760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:16.176062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.178474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:16.194592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 286/574] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:16.194592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.220572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cebb-f316-48d6-aa1f-4958855fc98c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.241782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:16.264515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:16.271326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.272129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.272434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.272804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.283365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.284940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:16.303324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:16.304635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:16.305737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:16.305737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:16.305737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:16.305737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 289/575] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:16.309936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.313760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b654f1-ca98-4b46-bbc5-67c1302610f1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.349439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.350059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.350342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.350619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.351369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ad6f1167ee1d479ab3c0a5a8d46d846d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:16.351690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.353161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:16.368526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 287/576] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/role_assignments?user.id=ad6f1167ee1d479ab3c0a5a8d46d846d&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:16.368526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.443525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f679c-52c7-42c7-9285-1971c483d669 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.487098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.487764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.488236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.488545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.492591 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdac486-4ca7-44ac-befb-b20f2499143d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.498249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:16.503541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.505212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:16.522632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:16.523641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:16.524707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:16.524707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:16.524707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:16.528725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 290/577] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:16.529492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.541937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.542732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.543114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.543605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.553992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.555606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:16.574184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:16.575324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:50:16.577441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:16.580150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 288/578] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:16.581168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.584123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:16.659332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbe913-2f97-48d0-bc89-f616a6e090dd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.709110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.710090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.710369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.710790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.711448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:16.711754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.713434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:16.718700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b62cd-a82f-4876-b0b5-e3be4598c2ba None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.734687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 291/579] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:16.735464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.760110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51826216-3439-4367-938a-eae28c8fc900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.761201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826216-3439-4367-938a-eae28c8fc900 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.761201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826216-3439-4367-938a-eae28c8fc900 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.761374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51826216-3439-4367-938a-eae28c8fc900 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.776558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51826216-3439-4367-938a-eae28c8fc900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-51826216-3439-4367-938a-eae28c8fc900 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:16.782020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:16.783030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:16.783854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 289/580] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:16.784983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51826216-3439-4367-938a-eae28c8fc900 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.815156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:16.866705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:16.874322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da183f-abcf-4812-943a-b4aeddcc4c24 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.925223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.926231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.927257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.927680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51826216-3439-4367-938a-eae28c8fc900 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:16.927907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.929274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:16.929780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.933442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:16.956711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 292/581] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:16.958771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:16.977569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:16.978208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.978461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.978740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.979614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:16.979926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:16.981554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.002273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 290/582] 10.222.0.75 () {56 vars in 1137 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:17.003300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.080512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98776b1e-c44e-415e-a6df-c107edf4b891 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.107272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.120944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.121596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.131124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.131124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.135906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.136447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21bf5d-1035-4d01-99b6-0562d360ed3e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.137729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:17.154370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:17.155425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:17.156365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 293/583] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:17.157722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.175444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.182682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.183094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.201082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.201082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.201082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:17.201082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.201082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.201082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 291/584] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:17.201617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.286842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317295fd-755b-43b9-9fd2-1ce03974ccb0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.324982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257eebe-b6a4-4a49-84a1-e4aa03fdf076 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.331077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.331366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.331562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.331830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.341294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.342190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:17.354581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:17.355518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:17.356384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 294/585] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:17.356928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.375155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.375794 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.376078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.376355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.389049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.390495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.393254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:17.406083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:17.413650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:17.414540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:17.414540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:17.414540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:17.414540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 292/586] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:17.414540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.469956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.504309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71562a5-97a9-4e9c-a62a-504317178317 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.547053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dfdb7-5773-48be-93fc-5ebc418dbdd2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.548962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.549595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.550587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.550587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.550878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:17.551184 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.553363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.575564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 295/587] 10.222.0.75 () {56 vars in 1137 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:17.576422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.600587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.601249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.601537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.601814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.619979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.621524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:17.640076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:17.641130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:17.642043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:17.642043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:17.642043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:17.642043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 293/588] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:17.642043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.698945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.712792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bf8ab-441e-4ac9-a8b7-84ce3e6084cb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.745691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.752049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.752697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.752977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.753245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.753941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:17.754317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.756364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.773284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 296/589] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:17.773284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.773599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a0ae2-505b-4a25-842a-9794b9b51554 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.812301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.813232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.813609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.814071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.814850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:17.815254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.816790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.835456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 294/590] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:17.835456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.896600 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5b162-4ba8-4ac8-9b78-7ee5f36b805a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.949153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.949808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.950092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.950369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.963495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7791a9-0b3d-4a36-9c62-35d986e24372 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.966511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.968005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.974697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:17.984124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:17.990014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:17.991007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:17.991007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:17.991007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:17.991007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 297/591] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:17.991007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.008806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.009858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.010379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.010836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.011701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:18.012204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.013898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.027286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 295/592] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:18.028452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.043183 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:18.112592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da776c0-0232-4265-ae4b-0c8022277d97 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.159133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555c510-356a-4ae4-8761-b71936586737 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.165043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f87437-974a-4b46-9816-e7626da0bffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.165955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87437-974a-4b46-9816-e7626da0bffb None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.166829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87437-974a-4b46-9816-e7626da0bffb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.167291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87437-974a-4b46-9816-e7626da0bffb None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ab4bb702760a4cd2b2cbf6f732b2360b/roles/d080aeef5e23467ba4a98bd13261f353` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.184093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f87437-974a-4b46-9816-e7626da0bffb None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=ab4bb702760a4cd2b2cbf6f732b2360b, role_id=d080aeef5e23467ba4a98bd13261f353)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.185821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f87437-974a-4b46-9816-e7626da0bffb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.195530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.196158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.196438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.196742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.203893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.206467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:18.223221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:18.224363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:18.225280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 296/593] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:18.226320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.262076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:18.335633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 298/594] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:50:17 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ab4bb702760a4cd2b2cbf6f732b2360b/roles/d080aeef5e23467ba4a98bd13261f353 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:50:18.336700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f87437-974a-4b46-9816-e7626da0bffb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.358510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eef25-64cf-4180-b02c-4797fce7ac93 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.396237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.397181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.397610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.398041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.398713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:18.399017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.400510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.418930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 297/595] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:18.418930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.492236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:18.512383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f87437-974a-4b46-9816-e7626da0bffb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.552999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.554817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.555334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.555900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.558450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:18.570277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.572427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.572779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b021ff2-ef5d-431b-91d0-e5ae7e28b439 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:18.591914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:18.600378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 299/596] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:18.601345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.627694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.628397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.628797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.629156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.630470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:18.630731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.632196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 298/597] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:18.646480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.730575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee31b7f-1fef-48bb-863d-eb7ef31e929e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.763524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5f4b5-da20-4159-806b-b32c89751992 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.776233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a64b2-30f9-462d-a668-c3158946f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.776918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a64b2-30f9-462d-a668-c3158946f29b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.777223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a64b2-30f9-462d-a668-c3158946f29b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.777467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a64b2-30f9-462d-a668-c3158946f29b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.784862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a64b2-30f9-462d-a668-c3158946f29b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.786875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a64b2-30f9-462d-a668-c3158946f29b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e98a64b2-30f9-462d-a668-c3158946f29b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:18.798780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:18.799715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:18.800666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 300/598] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:18.802127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f77c-0840-49d7-9978-1e981aa010ae None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.802402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f77c-0840-49d7-9978-1e981aa010ae None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.802730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f77c-0840-49d7-9978-1e981aa010ae None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.804253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 301/599] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:18.804989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f77c-0840-49d7-9978-1e981aa010ae None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.809393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.810018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.810307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.810580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.811325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:18.811634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.813117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.834254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 299/600] 10.222.0.75 () {56 vars in 1139 bytes} [Mon Sep 19 14:50:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:18.835183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:18.847476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:18.894503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:18.920331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f77c-0840-49d7-9978-1e981aa010ae None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.954966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9f8f-d6ce-4f11-9331-09f8b56c06f3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:18.957550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035339-3ab3-4623-a243-69f551cae4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.958277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035339-3ab3-4623-a243-69f551cae4f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.958593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035339-3ab3-4623-a243-69f551cae4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.958822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035339-3ab3-4623-a243-69f551cae4f1 None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/a203084e8c5d4cb6b258b2d39db4f9dd/roles/d080aeef5e23467ba4a98bd13261f353` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.976307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3035339-3ab3-4623-a243-69f551cae4f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=a203084e8c5d4cb6b258b2d39db4f9dd, role_id=d080aeef5e23467ba4a98bd13261f353)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.977931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3035339-3ab3-4623-a243-69f551cae4f1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:18.991678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498acf3d-c744-42fa-a56b-24031bf52f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:18.992220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498acf3d-c744-42fa-a56b-24031bf52f20 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:18.992535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498acf3d-c744-42fa-a56b-24031bf52f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:18.992819 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498acf3d-c744-42fa-a56b-24031bf52f20 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:18.993518 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498acf3d-c744-42fa-a56b-24031bf52f20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:18.993828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498acf3d-c744-42fa-a56b-24031bf52f20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:18.995240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498acf3d-c744-42fa-a56b-24031bf52f20 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:19.007190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 300/601] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:19.008376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548578-dd17-44e5-aac5-533eb13806ff None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:19.008692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548578-dd17-44e5-aac5-533eb13806ff None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:19.008964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548578-dd17-44e5-aac5-533eb13806ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:19.026860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8e548578-dd17-44e5-aac5-533eb13806ff None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:19.028071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8e548578-dd17-44e5-aac5-533eb13806ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:19.087938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:19.095432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 301/602] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:19.096249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548578-dd17-44e5-aac5-533eb13806ff None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:19.125860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 302/603] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:50:18 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/a203084e8c5d4cb6b258b2d39db4f9dd/roles/d080aeef5e23467ba4a98bd13261f353 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:50:19.127881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035339-3ab3-4623-a243-69f551cae4f1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:19.208456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548578-dd17-44e5-aac5-533eb13806ff None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:19.219290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:19.267576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035339-3ab3-4623-a243-69f551cae4f1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:19.298224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:19.299237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:19.299708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:19.300163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:19.318237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a2fdd-ebfb-4b88-845b-4a6788edbd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:19.319032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2fdd-ebfb-4b88-845b-4a6788edbd32 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:19.319381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2fdd-ebfb-4b88-845b-4a6788edbd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:19.320342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2fdd-ebfb-4b88-845b-4a6788edbd32 None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/aa1d30decad84c7081c7e150812b2964/roles/d080aeef5e23467ba4a98bd13261f353` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:19.325405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:19.327265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:19.339287 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a2fdd-ebfb-4b88-845b-4a6788edbd32 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=aa1d30decad84c7081c7e150812b2964, role_id=d080aeef5e23467ba4a98bd13261f353)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:19.344552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a2fdd-ebfb-4b88-845b-4a6788edbd32 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:19.356784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:19.357902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:19.359462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:19.359462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:19.359462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:19.359462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 302/604] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:19.366118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:19.421758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:19.491323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef689435-9bef-4746-979d-feb84303c0c2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:19.527059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:19.527598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:19.527876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:19.528149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:19.528834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:19.529148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:19.530538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:19.552053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 303/605] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:19.552053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:19.572736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 303/606] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:50:19 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/aa1d30decad84c7081c7e150812b2964/roles/d080aeef5e23467ba4a98bd13261f353 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:50:19.581446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a2fdd-ebfb-4b88-845b-4a6788edbd32 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:19.721717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a934c8-e35f-4bac-acaa-fea1a82256bb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:19.740892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:19.800999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f5bcf-ba21-4e95-a98f-367fb5007ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:19.801638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5bcf-ba21-4e95-a98f-367fb5007ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:19.801916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5bcf-ba21-4e95-a98f-367fb5007ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:19.802184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5bcf-ba21-4e95-a98f-367fb5007ea8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:19.826641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f5bcf-ba21-4e95-a98f-367fb5007ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:19.834822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a2fdd-ebfb-4b88-845b-4a6788edbd32 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-786f5bcf-ba21-4e95-a98f-367fb5007ea8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:19.840338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:19.841355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:19.842190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:19.844049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 304/607] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:19.851297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f5bcf-ba21-4e95-a98f-367fb5007ea8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:19.863403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:19.897702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:19.899847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:19.900898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:19.901681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:19.914654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:19.929339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:19.935800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:19.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:19.937702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:19.937702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:19.937702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:19.937702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:19.937702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:19.937702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:19.937702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:19.937702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:19.944666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 304/608] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:19.948561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:20.007075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f5bcf-ba21-4e95-a98f-367fb5007ea8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:20.081526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:20.082142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.082422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.083232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.084617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:20.085172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:20.087752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd60e0-2a4c-4d2f-ae24-07772280d495 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:20.093966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:20.115147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 305/609] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:20.129890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:20.134639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:20.136707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.138227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.138701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.139692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:20.140935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:20.142418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:20.164504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 305/610] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:20.177484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:20.179876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:20.243032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:20.256299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcaf6a-fa7f-4f8a-8ee8-a510c05293da None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:20.323914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f535-384e-4ef5-93a6-fd131ae75be5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:20.345907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:20.346484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.346847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.347134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.366853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:20.368339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:20.374533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891f947-e673-46ab-b352-b4ca553d0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:20.375339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f947-e673-46ab-b352-b4ca553d0d67 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.375690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f947-e673-46ab-b352-b4ca553d0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.375971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f947-e673-46ab-b352-b4ca553d0d67 None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/67d0bbf089504d408db0bb7055a780a6/roles/d080aeef5e23467ba4a98bd13261f353` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:20.385475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:20.386440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:20.387587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:20.387587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:20.387587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:20.387587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 306/611] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:20.397711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:20.404051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891f947-e673-46ab-b352-b4ca553d0d67 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=67d0bbf089504d408db0bb7055a780a6, role_id=d080aeef5e23467ba4a98bd13261f353)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:20.405765 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891f947-e673-46ab-b352-b4ca553d0d67 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:20.496849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:20.515098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38c004-c267-4741-b2b0-c055bc28d22b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:20.549493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:20.550107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.550386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.550660 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.551361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:20.552293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:20.553780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:20.570689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 307/612] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:20.572133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:20.684509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195daf3a-f810-47bb-8aea-f14ccb9d902e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:20.723024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:20.724618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.724618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.724989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.732993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:20.734553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:20.747194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:20.748188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:20.749175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:20.752718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 308/613] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:20.757266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:20.760221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:20.863454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcb20-aeb1-461e-be8e-b4a622dfb6ec None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:20.895937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61dad2-b822-4beb-8182-74cd582f2117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:20.896614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61dad2-b822-4beb-8182-74cd582f2117 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.896895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61dad2-b822-4beb-8182-74cd582f2117 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.897165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61dad2-b822-4beb-8182-74cd582f2117 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.897894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61dad2-b822-4beb-8182-74cd582f2117 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:20.898196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61dad2-b822-4beb-8182-74cd582f2117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:20.899683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61dad2-b822-4beb-8182-74cd582f2117 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:20.922126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 309/614] 10.222.0.75 () {56 vars in 1135 bytes} [Mon Sep 19 14:50:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:20.923466 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f30c1-f094-4389-b2e1-d490816231d8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.923634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 306/615] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:50:20 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/67d0bbf089504d408db0bb7055a780a6/roles/d080aeef5e23467ba4a98bd13261f353 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:50:20.923809 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f30c1-f094-4389-b2e1-d490816231d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.924091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f30c1-f094-4389-b2e1-d490816231d8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.925704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 310/616] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:20.931706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3a4c-fda1-420a-904a-319c22c71399 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.931988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3a4c-fda1-420a-904a-319c22c71399 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.932264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e3a4c-fda1-420a-904a-319c22c71399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.940789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f30c1-f094-4389-b2e1-d490816231d8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:20.966941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-595e3a4c-fda1-420a-904a-319c22c71399 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:20.968191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-595e3a4c-fda1-420a-904a-319c22c71399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:21.084665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 307/617] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:21.085074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:21.159314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f30c1-f094-4389-b2e1-d490816231d8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:21.202640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:21.203509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:21.203955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:21.204371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:21.216056 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:21.217770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:21.238051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:21.239104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:21.239992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:21.239992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:21.239992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:21.239992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 311/618] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:21.245035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e3a4c-fda1-420a-904a-319c22c71399 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:21.267498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:21.381884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e3a4c-fda1-420a-904a-319c22c71399 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:21.389810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:21.463935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:21.464560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:21.464846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:21.465121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:21.465777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:21.466081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:21.467464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:21.494105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 308/619] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:21.501378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:21.579151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404193-cb1a-4a58-bd25-ea398754c003 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:21.596041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:21.628151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a8603-b51b-4221-884a-f2588c24b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:21.628844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a8603-b51b-4221-884a-f2588c24b08a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:21.629132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a8603-b51b-4221-884a-f2588c24b08a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:21.629409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a8603-b51b-4221-884a-f2588c24b08a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:21.651452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a8603-b51b-4221-884a-f2588c24b08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:21.655451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a79a8603-b51b-4221-884a-f2588c24b08a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:21.661776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:21.662934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:21.663954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 312/620] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:21.669140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a8603-b51b-4221-884a-f2588c24b08a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:21.721014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7bfda-ab81-4c80-9182-352095734248 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:21.803123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:21.805176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:21.806616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:21.807139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:21.836508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:21.836508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:21.852392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:21.853398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:21.854276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 309/621] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:21.860370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:21.866578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a8603-b51b-4221-884a-f2588c24b08a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:21.914034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3672de-ff33-41e8-be8c-1903d89fa0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:21.914646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3672de-ff33-41e8-be8c-1903d89fa0eb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:21.914924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3672de-ff33-41e8-be8c-1903d89fa0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:21.915194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3672de-ff33-41e8-be8c-1903d89fa0eb None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:21.915927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3672de-ff33-41e8-be8c-1903d89fa0eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:21.916791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3672de-ff33-41e8-be8c-1903d89fa0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:21.918187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3672de-ff33-41e8-be8c-1903d89fa0eb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:21.936200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 313/622] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:21.936200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae593d4-1e6b-423a-b1fc-982c17bac405 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:21.936200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae593d4-1e6b-423a-b1fc-982c17bac405 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:21.936200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae593d4-1e6b-423a-b1fc-982c17bac405 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:21.936200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 314/623] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:21.936200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae593d4-1e6b-423a-b1fc-982c17bac405 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:21.990658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:21.992213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d758e87-4b3f-42f6-bf51-7da7f588be17 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:22.029859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110522d-7236-4ebc-8316-fecbf90fbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:22.030523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110522d-7236-4ebc-8316-fecbf90fbe92 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.030868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110522d-7236-4ebc-8316-fecbf90fbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.031211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110522d-7236-4ebc-8316-fecbf90fbe92 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.031964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110522d-7236-4ebc-8316-fecbf90fbe92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:22.032336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110522d-7236-4ebc-8316-fecbf90fbe92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:22.033877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110522d-7236-4ebc-8316-fecbf90fbe92 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:22.035975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:22.048106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 310/624] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:22.049546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bbadc-e039-471e-8c78-64eba7d46727 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.049882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bbadc-e039-471e-8c78-64eba7d46727 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.050215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bbadc-e039-471e-8c78-64eba7d46727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.070668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-677bbadc-e039-471e-8c78-64eba7d46727 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:22.072190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-677bbadc-e039-471e-8c78-64eba7d46727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:22.088729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae593d4-1e6b-423a-b1fc-982c17bac405 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:22.143186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb16a68-95eb-4602-8484-cbacc8ddf73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:22.146124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb16a68-95eb-4602-8484-cbacc8ddf73e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.146124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb16a68-95eb-4602-8484-cbacc8ddf73e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.146444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb16a68-95eb-4602-8484-cbacc8ddf73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.158145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 311/625] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:22.159113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bbadc-e039-471e-8c78-64eba7d46727 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:22.159777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb16a68-95eb-4602-8484-cbacc8ddf73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:22.161601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb16a68-95eb-4602-8484-cbacc8ddf73e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5eb16a68-95eb-4602-8484-cbacc8ddf73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:22.193357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:22.194400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:22.195272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:22.195272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:22.195272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:22.197427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 315/626] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:22.198810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc457d6-c401-4143-aaf4-a4f1f5b7bf26 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.199242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc457d6-c401-4143-aaf4-a4f1f5b7bf26 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.199655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc457d6-c401-4143-aaf4-a4f1f5b7bf26 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.202142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 316/627] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:22.203162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc457d6-c401-4143-aaf4-a4f1f5b7bf26 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:22.293058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bbadc-e039-471e-8c78-64eba7d46727 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:22.299506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:22.316856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc457d6-c401-4143-aaf4-a4f1f5b7bf26 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:22.321499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:22.332845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271bd5a-3ff1-4943-9c1c-6e75ea593092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:22.333813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271bd5a-3ff1-4943-9c1c-6e75ea593092 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.334249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271bd5a-3ff1-4943-9c1c-6e75ea593092 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.334665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271bd5a-3ff1-4943-9c1c-6e75ea593092 None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ad6f1167ee1d479ab3c0a5a8d46d846d/roles/d080aeef5e23467ba4a98bd13261f353` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.353039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271bd5a-3ff1-4943-9c1c-6e75ea593092 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=ad6f1167ee1d479ab3c0a5a8d46d846d, role_id=d080aeef5e23467ba4a98bd13261f353)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:22.354080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6576-7556-4963-8977-9d9cefdc7354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:22.354827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6576-7556-4963-8977-9d9cefdc7354 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.355132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271bd5a-3ff1-4943-9c1c-6e75ea593092 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:22.355251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6576-7556-4963-8977-9d9cefdc7354 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.355687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6576-7556-4963-8977-9d9cefdc7354 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.356444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6576-7556-4963-8977-9d9cefdc7354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:22.356867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6576-7556-4963-8977-9d9cefdc7354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:22.358408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b6576-7556-4963-8977-9d9cefdc7354 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:22.372224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 317/628] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:22.373667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc789-4dd7-4183-9ec1-82cb6c7f525c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.374779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc789-4dd7-4183-9ec1-82cb6c7f525c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.375154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc789-4dd7-4183-9ec1-82cb6c7f525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.394579 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9e7fc789-4dd7-4183-9ec1-82cb6c7f525c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:22.396872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9e7fc789-4dd7-4183-9ec1-82cb6c7f525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:22.465007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 318/629] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:22.465852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fc789-4dd7-4183-9ec1-82cb6c7f525c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:22.545912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:22.569564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fc789-4dd7-4183-9ec1-82cb6c7f525c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:22.604916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:22.605678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.606055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.606424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.621158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:22.621336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 312/630] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:50:22 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ad6f1167ee1d479ab3c0a5a8d46d846d/roles/d080aeef5e23467ba4a98bd13261f353 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:50:22.621683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:22.621786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271bd5a-3ff1-4943-9c1c-6e75ea593092 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:22.635250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:22.636306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:22.637319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 319/631] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:50:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:22.644085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:22.788592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54cae9-b778-49d5-b292-a0440776cbad None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:22.835582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:22.836607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.837390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.837718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.838529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:22.838839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:22.840842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:22.843584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271bd5a-3ff1-4943-9c1c-6e75ea593092 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:22.844864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:22.869306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 320/632] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:50:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:22.876700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:22.885623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b914f4-f131-446e-938c-4c5380a2c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:22.886260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b914f4-f131-446e-938c-4c5380a2c67a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:22.886538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b914f4-f131-446e-938c-4c5380a2c67a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:22.886810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b914f4-f131-446e-938c-4c5380a2c67a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:22.899936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b914f4-f131-446e-938c-4c5380a2c67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e2b914f4-f131-446e-938c-4c5380a2c67a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:22.905141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:22.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:22.906937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 313/633] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:22.911711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b914f4-f131-446e-938c-4c5380a2c67a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:22.947515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:23.008770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76cf39-a15f-421a-b8eb-2c09afaaff49 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.022843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b914f4-f131-446e-938c-4c5380a2c67a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.054551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dd9b4-4852-4cea-9961-b28a5c7d3132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.055191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dd9b4-4852-4cea-9961-b28a5c7d3132 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.055470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dd9b4-4852-4cea-9961-b28a5c7d3132 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.055744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dd9b4-4852-4cea-9961-b28a5c7d3132 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.065758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e73cb-9671-43d0-9723-0d3d307ce0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.066675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e73cb-9671-43d0-9723-0d3d307ce0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.067035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e73cb-9671-43d0-9723-0d3d307ce0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.067804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e73cb-9671-43d0-9723-0d3d307ce0c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.070685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dd9b4-4852-4cea-9961-b28a5c7d3132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2e0dd9b4-4852-4cea-9961-b28a5c7d3132 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:23.077227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:23.078157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:23.078986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:23.082056 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 321/634] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:23.083313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dd9b4-4852-4cea-9961-b28a5c7d3132 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.150154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:23.164355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e73cb-9671-43d0-9723-0d3d307ce0c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:23.166798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e73cb-9671-43d0-9723-0d3d307ce0c5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:23.201237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dd9b4-4852-4cea-9961-b28a5c7d3132 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.241274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.242372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.242795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.243216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.243675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:23.244187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:23.244817 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:23.246442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:23.255528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 322/635] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:23.256807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.290368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 314/636] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:23.292138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e73cb-9671-43d0-9723-0d3d307ce0c5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.414225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d020-d1bb-403f-bd89-edcfb5d90012 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.423102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e73cb-9671-43d0-9723-0d3d307ce0c5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.433633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:23.455847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.457035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.457720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.459002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.460170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:23.460682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:23.466680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:23.466836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.466836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.466836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.466836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.467150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:23.474560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 323/637] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:23.475844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.480625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:23.482691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:23.500509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:23.503716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:23.505348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:23.505348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:23.505348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:23.505348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 315/638] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:23.505348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.593712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223b648-b76b-4850-9a7d-2338d8d99e4b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.616988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321813dc-ad09-48f6-81c1-033c0a3d5db9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.631195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5b8bc-ba49-47e1-bd8c-607444658cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.631833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5b8bc-ba49-47e1-bd8c-607444658cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.632526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5b8bc-ba49-47e1-bd8c-607444658cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.632810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5b8bc-ba49-47e1-bd8c-607444658cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.643569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5b8bc-ba49-47e1-bd8c-607444658cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:23.646152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5b8bc-ba49-47e1-bd8c-607444658cb3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:23.654774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.655804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.656095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.656377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-60b5b8bc-ba49-47e1-bd8c-607444658cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:23.661870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:23.662974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:23.663933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:23.663933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:23.663933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:23.665370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 324/639] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:23.666734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583fa76-2a1e-4c3f-9fc6-5b25db87e899 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.667167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583fa76-2a1e-4c3f-9fc6-5b25db87e899 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.667590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583fa76-2a1e-4c3f-9fc6-5b25db87e899 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.669297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 325/640] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:23.670259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583fa76-2a1e-4c3f-9fc6-5b25db87e899 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.678281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:23.679923 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:23.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:23.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:23.704290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:23.704290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:23.704290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:23.704290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 316/641] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:23.704290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.719873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:23.756393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:23.803816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583fa76-2a1e-4c3f-9fc6-5b25db87e899 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.820943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7ee0-cb37-46d1-8d34-fe072bfd8f80 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:23.839742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b57c7-b773-4f17-909d-38544bff9f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.840352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b57c7-b773-4f17-909d-38544bff9f99 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.840674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b57c7-b773-4f17-909d-38544bff9f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.840952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b57c7-b773-4f17-909d-38544bff9f99 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.841608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b57c7-b773-4f17-909d-38544bff9f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:23.841916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b57c7-b773-4f17-909d-38544bff9f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:23.843289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b57c7-b773-4f17-909d-38544bff9f99 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:23.859877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 326/642] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:23.859877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149db5-9fc7-4c5b-9ac2-7b1b5086283b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.859877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149db5-9fc7-4c5b-9ac2-7b1b5086283b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.859877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149db5-9fc7-4c5b-9ac2-7b1b5086283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.862502 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:23.863195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:23.863580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:23.864516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:23.865235 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:23.865608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:23.867030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:23.877274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ef149db5-9fc7-4c5b-9ac2-7b1b5086283b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:23.878550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ef149db5-9fc7-4c5b-9ac2-7b1b5086283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:23.885401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 317/643] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:23.885401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.972902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 327/644] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:23.974540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149db5-9fc7-4c5b-9ac2-7b1b5086283b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:23.987292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:23.993094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e50bb-72e5-4da5-a8c4-01f4a9d9ec0f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.005315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.032353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.033372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.033660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.033936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.035007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:24.035319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.038509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.056401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 318/645] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:24.057303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.099013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149db5-9fc7-4c5b-9ac2-7b1b5086283b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.136913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.137551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.137882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.138160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.145457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.147073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:24.159201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:24.160123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:24.162288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 328/646] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:24.164079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.185731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7debce-25fc-4061-8202-679c0dd73078 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.232452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.233297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.233978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.234269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.244570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.246021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.254814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:24.262659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:24.264525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 319/647] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:24.266446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.275986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde97adc-0c33-4ae6-a21a-dce1ecf651dc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.290178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.310639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.311269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.311550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.311822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.319889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.321257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:24.332714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:24.333953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:50:24.335136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:24.338884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 329/648] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:24.339597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.389389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ce29c-443d-448d-abd6-17f2b5dfd406 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.426081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.427552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.427856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.428031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.428778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:24.429193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.430635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.448538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e77762-807c-42d2-9c5f-696444219302 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.453632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 320/649] 10.222.0.75 () {56 vars in 1137 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:24.454517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.485854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe9699-78c2-4818-a829-a5681ba27afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.486554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9699-78c2-4818-a829-a5681ba27afa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.487087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9699-78c2-4818-a829-a5681ba27afa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.487370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9699-78c2-4818-a829-a5681ba27afa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.496035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.499025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe9699-78c2-4818-a829-a5681ba27afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c3fe9699-78c2-4818-a829-a5681ba27afa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:24.504307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:24.505916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 330/650] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:24.517257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe9699-78c2-4818-a829-a5681ba27afa None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.546872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.571325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519429a1-32f1-4843-875d-45ca2cd076b3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.608310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.608978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.609258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.609534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.610230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:24.610538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.611948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.613723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe9699-78c2-4818-a829-a5681ba27afa None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.631462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 321/651] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:24.631462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.656645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.657263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.657552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.657798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.658532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:24.658841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.660543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.684584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 331/652] 10.222.0.75 () {56 vars in 1137 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:24.684584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.744792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273e806-e80c-4be3-8961-d36248051c87 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.745604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.795175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad245-9030-453d-9e23-0ef3ba8f0b14 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.795914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b1ab-4d7c-428b-a71d-b6c247dd3720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.796624 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b1ab-4d7c-428b-a71d-b6c247dd3720 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.796986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b1ab-4d7c-428b-a71d-b6c247dd3720 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.797321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b1ab-4d7c-428b-a71d-b6c247dd3720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.801057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.839166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.839892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.840243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.840618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.841361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:24.841732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.843178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.852650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 332/653] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:24.853415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.876143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7b1ab-4d7c-428b-a71d-b6c247dd3720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.877919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7b1ab-4d7c-428b-a71d-b6c247dd3720 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:24.961469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3ef5f-0cc9-4086-8897-789c35d5d98a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:24.981191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:24.982292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 322/654] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:24.983067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b1ab-4d7c-428b-a71d-b6c247dd3720 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:24.995735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003438-5f42-4360-820e-5652d0612697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:24.996273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003438-5f42-4360-820e-5652d0612697 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:24.996582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003438-5f42-4360-820e-5652d0612697 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:24.996855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003438-5f42-4360-820e-5652d0612697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:24.997589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24003438-5f42-4360-820e-5652d0612697 None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ab4bb702760a4cd2b2cbf6f732b2360b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:24.997894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24003438-5f42-4360-820e-5652d0612697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:24.999310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24003438-5f42-4360-820e-5652d0612697 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.005569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 333/655] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/role_assignments?user.id=ab4bb702760a4cd2b2cbf6f732b2360b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:25.007432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003438-5f42-4360-820e-5652d0612697 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.018192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:25.100499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b1ab-4d7c-428b-a71d-b6c247dd3720 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:25.121938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003438-5f42-4360-820e-5652d0612697 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:25.142288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30231966-bdec-41ae-9399-5dad9c759445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:25.142920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30231966-bdec-41ae-9399-5dad9c759445 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.143201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30231966-bdec-41ae-9399-5dad9c759445 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.143480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30231966-bdec-41ae-9399-5dad9c759445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.159210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5425a0-84a8-4bc3-bc78-28ae5801afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:25.160355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5425a0-84a8-4bc3-bc78-28ae5801afe1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.160898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5425a0-84a8-4bc3-bc78-28ae5801afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.161354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5425a0-84a8-4bc3-bc78-28ae5801afe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.175997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5425a0-84a8-4bc3-bc78-28ae5801afe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:25.178291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5425a0-84a8-4bc3-bc78-28ae5801afe1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1f5425a0-84a8-4bc3-bc78-28ae5801afe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:25.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:25.195558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:25.196607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:25.196607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:25.196607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:25.196607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 334/656] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:25.198040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c05b-d8d3-4fb6-ab52-026593231389 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.198392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c05b-d8d3-4fb6-ab52-026593231389 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.198716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c05b-d8d3-4fb6-ab52-026593231389 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.200374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 335/657] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:25.201229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c05b-d8d3-4fb6-ab52-026593231389 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.225671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30231966-bdec-41ae-9399-5dad9c759445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:25.227118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30231966-bdec-41ae-9399-5dad9c759445 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.316269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c05b-d8d3-4fb6-ab52-026593231389 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:25.341824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 323/658] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:25.341824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30231966-bdec-41ae-9399-5dad9c759445 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.357293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f4dbf-0518-44eb-8256-2b4f3ffc8798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:25.357925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4dbf-0518-44eb-8256-2b4f3ffc8798 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.358205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4dbf-0518-44eb-8256-2b4f3ffc8798 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.358474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4dbf-0518-44eb-8256-2b4f3ffc8798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.372159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f4dbf-0518-44eb-8256-2b4f3ffc8798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:25.374250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f4dbf-0518-44eb-8256-2b4f3ffc8798 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c89f4dbf-0518-44eb-8256-2b4f3ffc8798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:25.392179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:25.393509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:25.394540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:25.394540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:25.394540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:25.394540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 336/659] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:25.394540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691aa59-3d66-45f4-891e-844086b02d1a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.394830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691aa59-3d66-45f4-891e-844086b02d1a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.395115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691aa59-3d66-45f4-891e-844086b02d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.413384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a691aa59-3d66-45f4-891e-844086b02d1a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:25.414585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a691aa59-3d66-45f4-891e-844086b02d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:25.461609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30231966-bdec-41ae-9399-5dad9c759445 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:25.483076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 337/660] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:25.483752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691aa59-3d66-45f4-891e-844086b02d1a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.510268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:25.511487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.511991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.512638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.513836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:25.514584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:25.516715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.532519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 324/661] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:25.534066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.543390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:25.610883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691aa59-3d66-45f4-891e-844086b02d1a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:25.647943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:25.649042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.649583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.650072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.661405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:25.664903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.672708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce36a5-9a3e-497b-a617-97d025ed4568 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:25.679727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:25.680711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:25.681589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:25.681589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:25.681589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:25.683045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 338/662] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:25.684089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.718543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:25.723918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:25.724584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.724873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.725154 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.725804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:25.726117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:25.727490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.744641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 325/663] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:25.745847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.788409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:25.807801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d23981-a083-4d5d-a55b-2fa296a70253 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:25.842620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:25.843257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.843534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.843808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.850719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:25.852969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:25.854437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.854542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153bbc8-6280-4826-8195-90d33484ed34 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:25.873025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:25.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 339/664] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:25.875361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.897836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:25.898795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:25.899232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:25.899671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:25.900539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:25.900849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:25.901398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:25.902206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:25.919594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 326/665] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:25.919594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:25.965761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:25.982216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c671d95-da2b-4667-853f-e3122655ce1c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.015502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:26.021967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.022600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.022884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.023156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.029675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fc3e8-29e8-4460-b757-02a71c623bdb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.030065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.031519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:26.043463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:26.044412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 340/666] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:26.045351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.056618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:26.081273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726bb3-6cc0-4f09-859b-337fb9fef66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.082531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726bb3-6cc0-4f09-859b-337fb9fef66a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.083042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726bb3-6cc0-4f09-859b-337fb9fef66a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.083479 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726bb3-6cc0-4f09-859b-337fb9fef66a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.095468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3726bb3-6cc0-4f09-859b-337fb9fef66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f3726bb3-6cc0-4f09-859b-337fb9fef66a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:26.101903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:26.103020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:26.104051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:26.105791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 327/667] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:26.106601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726bb3-6cc0-4f09-859b-337fb9fef66a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.158311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a071f5d-2161-4dae-9268-d024cd674179 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.193962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.194567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.194855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.195132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.195867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:26.196173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.197641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.220162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 341/668] 10.222.0.75 () {56 vars in 1139 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:26.220162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.227968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726bb3-6cc0-4f09-859b-337fb9fef66a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.266666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.267307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.267591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.267867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.268704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:26.276797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.281299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:26.290314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:26.291222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:26.292106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 328/669] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:26.292656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.326202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b2fd-91c3-4a29-a74a-59a7bfbbcc8d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.332380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:26.362773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.363393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.363675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.364054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.364929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:26.365242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.366684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.380064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 342/670] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:26.381241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.410150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ec9b0-c339-43e4-b8b7-79204c8fa069 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.447668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.448281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.448668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.448948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.449623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:26.449913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.451271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.460966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 329/671] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:26.461783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.501221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131809d6-4828-41a2-b4c0-2cb233ab1904 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.512176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:26.539433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1a44f-9321-4cdf-990e-dd7ef2d0eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.540276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1a44f-9321-4cdf-990e-dd7ef2d0eef6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.540756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1a44f-9321-4cdf-990e-dd7ef2d0eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.541274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1a44f-9321-4cdf-990e-dd7ef2d0eef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.573859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:26.578181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021912c6-71c2-420a-86a3-7706e4708e98 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.613407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1a44f-9321-4cdf-990e-dd7ef2d0eef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.615465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1a44f-9321-4cdf-990e-dd7ef2d0eef6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.615669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.616249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.616564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.616839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.617524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:26.617888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.619296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.636421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 330/672] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:26.636421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.732927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 343/673] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:26.733701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1a44f-9321-4cdf-990e-dd7ef2d0eef6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.746117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:26.748917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a3a8-2be5-4d74-a905-8d74b28c29ef None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.794728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.795351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.795687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.795967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.796730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=a203084e8c5d4cb6b258b2d39db4f9dd) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:26.797042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.798540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.816520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 331/674] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/role_assignments?user.id=a203084e8c5d4cb6b258b2d39db4f9dd&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:26.816520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.838735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:26.873437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1a44f-9321-4cdf-990e-dd7ef2d0eef6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.924615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.925313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.926055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.926957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.939713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a358b60-2843-4dcf-b5e2-b23c9dfa907a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:26.941336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.944750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:26.965798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:26.966803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:26.968167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:26.968167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:26.968167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:26.968167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 344/675] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:26.969570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:26.985677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:26.986235 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:26.986522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:26.986799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:26.987549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=aa1d30decad84c7081c7e150812b2964) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:26.987990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:26.990142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:27.000778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 332/676] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/role_assignments?user.id=aa1d30decad84c7081c7e150812b2964&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:27.001894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:27.049556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:27.108735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c296-43e3-427a-9638-634e6fe6e884 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:27.124111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:27.146935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fd4ba-1f98-413b-b073-39ec9af8fe85 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:27.159831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:27.159831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.159831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.159831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.169565 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:27.171365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:27.189738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:27.191035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:27.191964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:27.191964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:27.191964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:27.194817 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 345/677] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:27.195122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:27.195741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.196021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.196292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.200150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:27.200150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:27.200150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:27.202960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:27.219633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 333/678] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:27.224125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:27.336786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091c3fb-dac0-46aa-b68f-8214bbeb1d4d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:27.359794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e8f94-59ac-46df-a1c1-d67bdfaa847a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:27.362794 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:27.382424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40715cd4-d412-46ea-a846-b612e9ad0b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:27.383050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715cd4-d412-46ea-a846-b612e9ad0b0a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.383335 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715cd4-d412-46ea-a846-b612e9ad0b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.383614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40715cd4-d412-46ea-a846-b612e9ad0b0a None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.389229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40715cd4-d412-46ea-a846-b612e9ad0b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:27.389229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40715cd4-d412-46ea-a846-b612e9ad0b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:27.389229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40715cd4-d412-46ea-a846-b612e9ad0b0a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:27.404825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 346/679] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:27.411867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41023-c0a0-45f7-87c1-48f0ae819a2f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.412579 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41023-c0a0-45f7-87c1-48f0ae819a2f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.413102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41023-c0a0-45f7-87c1-48f0ae819a2f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.413579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15468a99-3206-4437-bf69-d1645562966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:27.415555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468a99-3206-4437-bf69-d1645562966d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.415555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468a99-3206-4437-bf69-d1645562966d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.415555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468a99-3206-4437-bf69-d1645562966d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.417544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 347/680] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:27.418494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea41023-c0a0-45f7-87c1-48f0ae819a2f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:27.428947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15468a99-3206-4437-bf69-d1645562966d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:27.430395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15468a99-3206-4437-bf69-d1645562966d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-15468a99-3206-4437-bf69-d1645562966d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:27.446420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:27.447406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:27.448365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 334/681] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:27.449703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8cade-3589-4cca-8b55-81ed66e3d8e6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.449703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8cade-3589-4cca-8b55-81ed66e3d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.449878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8cade-3589-4cca-8b55-81ed66e3d8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.466640 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:27.472094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-27e8cade-3589-4cca-8b55-81ed66e3d8e6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:27.473947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-27e8cade-3589-4cca-8b55-81ed66e3d8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:27.546868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 335/682] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:27.548176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8cade-3589-4cca-8b55-81ed66e3d8e6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:27.562787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea41023-c0a0-45f7-87c1-48f0ae819a2f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:27.652600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:27.653618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.654114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.654682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.673443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:27.675569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:27.697312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:27.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:27.699174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:27.699174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:27.699174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:27.699174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:27.699174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:27.699174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:27.699174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:27.699174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:27.702210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 348/683] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:27.709392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:27.739275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8cade-3589-4cca-8b55-81ed66e3d8e6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:27.768250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:27.819404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:27.820606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.821918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.822202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.823062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:27.823413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:27.824983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:27.830175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:27.859661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 336/684] 10.222.0.75 () {56 vars in 1135 bytes} [Mon Sep 19 14:50:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:27.864771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:27.888933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44da8-1be0-48c1-b8de-657f57863d11 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:27.925716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:27.926592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:27.927025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:27.927449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:27.928322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:27.928815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:27.930412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:27.949661 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 349/685] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:27.950784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:27.988070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a571-9142-4ca5-ac02-8b6219c4a3a0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:28.029079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9666e5-b1e7-4987-a0cf-53a138d0916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:28.030395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9666e5-b1e7-4987-a0cf-53a138d0916d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:28.030978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9666e5-b1e7-4987-a0cf-53a138d0916d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:28.031561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9666e5-b1e7-4987-a0cf-53a138d0916d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:28.046023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9666e5-b1e7-4987-a0cf-53a138d0916d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:28.051752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-5d9666e5-b1e7-4987-a0cf-53a138d0916d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:28.053342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:28.054240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:28.055106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:28.057836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 337/686] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:28.058906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9666e5-b1e7-4987-a0cf-53a138d0916d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:28.065600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0be39-5e7c-4dbd-8ab1-c2e8e1d413f7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:28.103986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7a772-2f25-417a-bdd2-f0c60c58271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:28.104660 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7a772-2f25-417a-bdd2-f0c60c58271a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:28.104972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7a772-2f25-417a-bdd2-f0c60c58271a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:28.105227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7a772-2f25-417a-bdd2-f0c60c58271a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:28.124256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:28.173862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9666e5-b1e7-4987-a0cf-53a138d0916d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:28.178000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7a772-2f25-417a-bdd2-f0c60c58271a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:28.179076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7a772-2f25-417a-bdd2-f0c60c58271a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:28.214225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:28.215204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:28.215689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:28.216231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:28.217345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=67d0bbf089504d408db0bb7055a780a6) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:28.217927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:28.219866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:28.232871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 338/687] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:28 2022] GET /identity/v3/role_assignments?user.id=67d0bbf089504d408db0bb7055a780a6&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:28.234276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:28.280953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:28.296519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 350/688] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:28.297787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7a772-2f25-417a-bdd2-f0c60c58271a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:28.388551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3467fe-20dd-40a1-8fed-48505e73f870 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:28.408464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:28.435336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:28.435336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:28.435336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:28.435336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:28.435797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:28.435797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:28.435797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:28.444915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 339/689] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:28.451411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:28.498763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7a772-2f25-417a-bdd2-f0c60c58271a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:28.553334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:28.554262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:28.554547 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:28.554822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:28.570448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:28.572449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:28.574897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d20bd-1b62-41f4-add0-c8ba6cf0d8ca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:28.592260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:28.593292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:28.594187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:28.594187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:28.594187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:28.594187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 351/690] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:28.599918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:28.618911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:28.619551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:28.619829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:28.620103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:28.633492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:28.635255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:28.651793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:28.654076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:28.656252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:28.656252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:28.656252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:28.656252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 340/691] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:28.659035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:28.687411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:28.704891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:28.775173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa2a27-5364-4da7-9291-53b92fb7bb48 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:28.818672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:28.820085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:28.820661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:28.821157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:28.822023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:28.822545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:28.824423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:28.839757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 341/692] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:28.846718 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:28.877074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ea3e-a491-4002-91e0-c5c79533059a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:28.950960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:28.951504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:28.951791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:28.952070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:28.952766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:28.953077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:28.954748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:28.982683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 352/693] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:28.992345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:29.020989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:29.041920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cbb96-fd99-442c-8964-45a27f89963e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:29.126289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:29.126945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.127225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.127503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.146221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:29.147682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:29.149841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d12d67-13ee-4fed-a7b6-804764698604 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:29.152311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:29.178395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:29.179448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:29.180411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:29.184588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 342/694] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:50:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:29.189502 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:29.194534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:29.195488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.195816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.196209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.204241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:29.206289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:29.220028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:29.220964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:29.221855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 353/695] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:29.228075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:29.393192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9389c-af6e-46a7-a1e3-a0ff96cc023c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:29.421691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789776-e3dd-42f7-88e1-7f08ee291122 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:29.463344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:29.464291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.464806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.465003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:29.465656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.465971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.466334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.466490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.467167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:29.467471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:29.468455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:29.469011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:29.469123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:29.470833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:29.483049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 354/696] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:29.491533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:29.508227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 343/697] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:50:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:29.530723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:29.548674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:29.548875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:29.655773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafee2d-00bc-4e5b-bd4f-dcc8d8bd4cea None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:29.670130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd385b7-8c9b-44d8-be5d-dc77619b0259 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:29.701292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231b8c-7bdf-4375-b2ac-559319cff81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:29.701654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231b8c-7bdf-4375-b2ac-559319cff81e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.701877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231b8c-7bdf-4375-b2ac-559319cff81e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.702150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231b8c-7bdf-4375-b2ac-559319cff81e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.703156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13231b8c-7bdf-4375-b2ac-559319cff81e None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ad6f1167ee1d479ab3c0a5a8d46d846d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:29.703603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13231b8c-7bdf-4375-b2ac-559319cff81e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:29.705475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13231b8c-7bdf-4375-b2ac-559319cff81e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:29.720663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 355/698] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:29 2022] GET /identity/v3/role_assignments?user.id=ad6f1167ee1d479ab3c0a5a8d46d846d&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:29.720663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb620e-7182-4cf1-8698-db4d934f4f9e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.720663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb620e-7182-4cf1-8698-db4d934f4f9e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.720663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb620e-7182-4cf1-8698-db4d934f4f9e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.721131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 356/699] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:29.731731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae25b91-b0e7-4011-8e50-9362e2621281 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.732069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae25b91-b0e7-4011-8e50-9362e2621281 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.732390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae25b91-b0e7-4011-8e50-9362e2621281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.739165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8062cb-82f2-4331-b89b-59c4e5390657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:29.739959 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8062cb-82f2-4331-b89b-59c4e5390657 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.740366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8062cb-82f2-4331-b89b-59c4e5390657 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.740734 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8062cb-82f2-4331-b89b-59c4e5390657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.785152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dae25b91-b0e7-4011-8e50-9362e2621281 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:29.788238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dae25b91-b0e7-4011-8e50-9362e2621281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:29.879853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8062cb-82f2-4331-b89b-59c4e5390657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:29.881769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8062cb-82f2-4331-b89b-59c4e5390657 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:29.897728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:29.904514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 357/700] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:29.904514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0576-be59-4ea2-ac6d-8240a47f03c9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.904514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0576-be59-4ea2-ac6d-8240a47f03c9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.904514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0576-be59-4ea2-ac6d-8240a47f03c9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.904514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 358/701] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:29.909412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763654-986f-45f9-afe1-344c2921b9a8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:29.915289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763654-986f-45f9-afe1-344c2921b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:29.915289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763654-986f-45f9-afe1-344c2921b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:29.939525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-af763654-986f-45f9-afe1-344c2921b9a8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:29.940842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-af763654-986f-45f9-afe1-344c2921b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:29.966190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:30.030841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 344/702] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:30.036642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8062cb-82f2-4331-b89b-59c4e5390657 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:30.040550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 359/703] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:30.156180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8062cb-82f2-4331-b89b-59c4e5390657 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:30.169120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:30.198610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:30.199583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:30.200072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:30.200633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:30.215427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:30.217186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:30.233909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:30.235035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:30.235941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:30.235941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:30.235941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:30.238414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 345/704] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:30.244517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763654-986f-45f9-afe1-344c2921b9a8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:30.264688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:30.376849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763654-986f-45f9-afe1-344c2921b9a8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:30.401865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8386872-ed94-4eca-ad9d-684bbda831d2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:30.440212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:30.441310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:30.441861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:30.442514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:30.443372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:30.443885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:30.445708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:30.445946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:30.446563 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:30.446842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:30.447112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:30.447693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:30.449332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:30.462706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 360/705] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:30.463849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:30.468692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:30.469708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:30.470837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:30.474558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 346/706] 10.222.0.75 () {56 vars in 1129 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:30.480515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:30.483448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:30.512542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:30.597503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b84ff-f106-4907-9916-728e154241d9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:30.610966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772760a0-1562-488c-a553-cf8e17dbb1dd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:30.644768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:30.645674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:30.646136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:30.646411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:30.654013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:30.654165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:30.655013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:30.655487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:30.655698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:30.656240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:30.668554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:30.669498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:30.670863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:30.670863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:30.670863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:30.670863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:30.670863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:30.670863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:30.670863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:30.670863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:30.672380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:30.674252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:30.674667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 347/707] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:30.675703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:30.695957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:30.697238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:30.698183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:30.698183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:30.698183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:30.698183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 361/708] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:30.698183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:30.781025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:30.808770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:30.825349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a6c47-1d9d-4c62-a2bd-f00e5134c6db None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:30.831988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a6470-7846-4176-a0da-bffb393ba98b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:30.867365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:30.867983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:30.868259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:30.868561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:30.869196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:30.869503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:30.870851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:30.871837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fadd3b-3510-4a1c-8ac0-af66ce202be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:30.872446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fadd3b-3510-4a1c-8ac0-af66ce202be6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:30.872758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fadd3b-3510-4a1c-8ac0-af66ce202be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:30.873041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fadd3b-3510-4a1c-8ac0-af66ce202be6 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:30.873747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fadd3b-3510-4a1c-8ac0-af66ce202be6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:30.874055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fadd3b-3510-4a1c-8ac0-af66ce202be6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:30.875484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fadd3b-3510-4a1c-8ac0-af66ce202be6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:30.880774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 348/709] 10.222.0.75 () {56 vars in 1124 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:30.880774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:30.889408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 362/710] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:30.890975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164dd0-c966-4e55-a46e-18de4b112bf3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:30.891345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164dd0-c966-4e55-a46e-18de4b112bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:30.891692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83164dd0-c966-4e55-a46e-18de4b112bf3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:30.893157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 363/711] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:30.893742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83164dd0-c966-4e55-a46e-18de4b112bf3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:31.003057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6962e-1e0d-42ed-9b1b-4de449ce34da None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:31.009962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83164dd0-c966-4e55-a46e-18de4b112bf3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:31.031921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:31.042224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:31.046330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.046330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.046330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.046330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:31.046330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:31.046330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:31.050856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900dc3-cf7f-4a6b-a83d-0bdebe2e7afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:31.051577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900dc3-cf7f-4a6b-a83d-0bdebe2e7afb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.051861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900dc3-cf7f-4a6b-a83d-0bdebe2e7afb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.052134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900dc3-cf7f-4a6b-a83d-0bdebe2e7afb None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.052799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900dc3-cf7f-4a6b-a83d-0bdebe2e7afb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:31.053643 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900dc3-cf7f-4a6b-a83d-0bdebe2e7afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:31.055458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900dc3-cf7f-4a6b-a83d-0bdebe2e7afb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:31.062780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 349/712] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:31.062780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:31.065654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 364/713] 10.222.0.75 () {56 vars in 1124 bytes} [Mon Sep 19 14:50:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:31.067306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f38088-fa24-4c31-ab5a-56d6fb247949 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.067681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f38088-fa24-4c31-ab5a-56d6fb247949 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.067962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f38088-fa24-4c31-ab5a-56d6fb247949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.098455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:31.099028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f3f38088-fa24-4c31-ab5a-56d6fb247949 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:31.100323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f3f38088-fa24-4c31-ab5a-56d6fb247949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:31.193246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 365/714] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:31.194482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f38088-fa24-4c31-ab5a-56d6fb247949 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:31.213229 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d404244-1f8a-4037-abdb-c5e9c78aeeb2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:31.271053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:31.271650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.271930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.272202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.276063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ab4bb702760a4cd2b2cbf6f732b2360b) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:31.276378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:31.277865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:31.292517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 350/715] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:31 2022] GET /identity/v3/role_assignments?user.id=ab4bb702760a4cd2b2cbf6f732b2360b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:31.355822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f38088-fa24-4c31-ab5a-56d6fb247949 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:31.376814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:31.400281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3293b71-cbf4-475d-95b9-e50712444cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:31.400952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3293b71-cbf4-475d-95b9-e50712444cca None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.401237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3293b71-cbf4-475d-95b9-e50712444cca None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.401510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3293b71-cbf4-475d-95b9-e50712444cca None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.402184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3293b71-cbf4-475d-95b9-e50712444cca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:31.403731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3293b71-cbf4-475d-95b9-e50712444cca None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:31.527977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:31.549664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 366/716] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:50:31 2022] POST /identity/v3/users => generated 254 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:31.618888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:31.647075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5bc7-8353-4bda-87d9-50fe08a6847f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:31.686968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:31.687637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.687868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.688140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] PATH_INFO: `/v3/services/network` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.688768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:31.690141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:31.699917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:31.701007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:31.701873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 351/717] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:31 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:31.707323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3293b71-cbf4-475d-95b9-e50712444cca None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:31.864744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3293b71-cbf4-475d-95b9-e50712444cca None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:31.909100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e3215-32e4-4404-8c84-5033c9fd2f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:31.909715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e3215-32e4-4404-8c84-5033c9fd2f2e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:31.909995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e3215-32e4-4404-8c84-5033c9fd2f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:31.910268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e3215-32e4-4404-8c84-5033c9fd2f2e None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:31.910941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e3215-32e4-4404-8c84-5033c9fd2f2e None admin] RBAC: Adding query filter params (name=network) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:31.911243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e3215-32e4-4404-8c84-5033c9fd2f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:31.912634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e3215-32e4-4404-8c84-5033c9fd2f2e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:31.919937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 367/718] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:50:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:31.925364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:32.039288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c82593-58d4-4851-9fed-ae35fd39d564 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:32.078832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556056f-6ee0-4b70-9383-55c198e5efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:32.079455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556056f-6ee0-4b70-9383-55c198e5efdc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:32.079733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556056f-6ee0-4b70-9383-55c198e5efdc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:32.080007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556056f-6ee0-4b70-9383-55c198e5efdc None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:32.081029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556056f-6ee0-4b70-9383-55c198e5efdc None admin] RBAC: Adding query filter params (type=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:32.081346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556056f-6ee0-4b70-9383-55c198e5efdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:32.083324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556056f-6ee0-4b70-9383-55c198e5efdc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:32.090275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 352/719] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:50:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:32.547251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298eae6-4bc8-4452-88a9-09b3ccb20ef4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:32.547765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298eae6-4bc8-4452-88a9-09b3ccb20ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:32.547844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298eae6-4bc8-4452-88a9-09b3ccb20ef4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:32.549414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 368/720] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:32.555026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876a91-eaf8-4462-a0a6-dc8c721bab73 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:32.555313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876a91-eaf8-4462-a0a6-dc8c721bab73 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:32.555592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876a91-eaf8-4462-a0a6-dc8c721bab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:32.563350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:32.581487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3e876a91-eaf8-4462-a0a6-dc8c721bab73 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:32.583488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3e876a91-eaf8-4462-a0a6-dc8c721bab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:32.672389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 353/721] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:33.061876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298eae6-4bc8-4452-88a9-09b3ccb20ef4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:33.122120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:33.206659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298eae6-4bc8-4452-88a9-09b3ccb20ef4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:33.255619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04660f80-4e59-4127-9e90-759be8e6f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:33.256657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660f80-4e59-4127-9e90-759be8e6f958 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:33.257153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660f80-4e59-4127-9e90-759be8e6f958 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:33.257631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660f80-4e59-4127-9e90-759be8e6f958 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:33.274484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04660f80-4e59-4127-9e90-759be8e6f958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-04660f80-4e59-4127-9e90-759be8e6f958 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:33.280235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:33.281320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:33.282161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:33.284698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 369/722] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:33.293590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e876a91-eaf8-4462-a0a6-dc8c721bab73 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:33.420930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e876a91-eaf8-4462-a0a6-dc8c721bab73 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:33.456762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:33.468323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:33.469899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:33.470013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:33.470435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:33.471675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:33.472244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:33.474938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:33.492384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 354/723] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:33.493758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04660f80-4e59-4127-9e90-759be8e6f958 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:33.662358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:33.669895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04660f80-4e59-4127-9e90-759be8e6f958 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:33.707421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724e5e-653c-4d78-bc8f-c85c4cdb8bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:33.708659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724e5e-653c-4d78-bc8f-c85c4cdb8bef None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:33.709125 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724e5e-653c-4d78-bc8f-c85c4cdb8bef None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:33.709601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724e5e-653c-4d78-bc8f-c85c4cdb8bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:33.721011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724e5e-653c-4d78-bc8f-c85c4cdb8bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:33.722706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724e5e-653c-4d78-bc8f-c85c4cdb8bef None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0e724e5e-653c-4d78-bc8f-c85c4cdb8bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:33.747074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:33.748170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:33.749112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:33.749112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:33.749112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:33.751129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 370/724] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:33.760616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:33.927613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ac0f-ad58-40e4-9b4c-3815c09d45ac None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:33.963177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc02e-18cd-4535-93f4-f10cc0b26b6f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:33.963883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc02e-18cd-4535-93f4-f10cc0b26b6f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:33.964605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc02e-18cd-4535-93f4-f10cc0b26b6f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:33.966782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 371/725] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:33.972044 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364cc8-3b55-4168-b73a-49641bae4e4e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:33.972595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364cc8-3b55-4168-b73a-49641bae4e4e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:33.973190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364cc8-3b55-4168-b73a-49641bae4e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:33.985445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:33.991243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:33.991741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:33.992210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:33.993179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:33.993683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:33.995249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:34.008570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-55364cc8-3b55-4168-b73a-49641bae4e4e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:34.010232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-55364cc8-3b55-4168-b73a-49641bae4e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:34.024020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 355/726] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:34.029294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:34.154494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.156395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 372/727] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:50:34.168464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76562e-b9cc-4dc3-ba9b-e3556fbe5369 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.169026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76562e-b9cc-4dc3-ba9b-e3556fbe5369 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.169333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76562e-b9cc-4dc3-ba9b-e3556fbe5369 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.171437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 373/728] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:50:34.178613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aff1c-d4ec-4815-9c0e-50bd335aa9ba None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.179240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aff1c-d4ec-4815-9c0e-50bd335aa9ba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.181231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aff1c-d4ec-4815-9c0e-50bd335aa9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.215750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f91aff1c-d4ec-4815-9c0e-50bd335aa9ba None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:34.218151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f91aff1c-d4ec-4815-9c0e-50bd335aa9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:34.248990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2f9b-ebe3-4374-b9b5-c7fda1f81b82 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:34.319250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946625f-c446-4946-ac86-7acb914c6233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:34.321386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946625f-c446-4946-ac86-7acb914c6233 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.322012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946625f-c446-4946-ac86-7acb914c6233 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.323563 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946625f-c446-4946-ac86-7acb914c6233 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.338594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946625f-c446-4946-ac86-7acb914c6233 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:34.341107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946625f-c446-4946-ac86-7acb914c6233 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6946625f-c446-4946-ac86-7acb914c6233 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:34.360238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:34.361500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:34.362681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:34.368331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 374/729] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:50:34.369564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 356/730] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:34.378045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aff1c-d4ec-4815-9c0e-50bd335aa9ba None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:34.392705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.486027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ba62-5149-40fd-91e5-25123005c082 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.486218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ba62-5149-40fd-91e5-25123005c082 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.486475 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ba62-5149-40fd-91e5-25123005c082 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.487943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 357/731] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:34.493992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a0bf-5307-4562-a218-b06c16b2b34e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.494259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a0bf-5307-4562-a218-b06c16b2b34e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.494534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a0bf-5307-4562-a218-b06c16b2b34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.541523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9b75a0bf-5307-4562-a218-b06c16b2b34e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:34.548271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9b75a0bf-5307-4562-a218-b06c16b2b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:34.570767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aff1c-d4ec-4815-9c0e-50bd335aa9ba None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:34.607747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:34.608353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.608678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.608960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.609691 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:34.609992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:34.611697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:34.630739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 375/732] 10.222.0.75 () {56 vars in 1135 bytes} [Mon Sep 19 14:50:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:34.631622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:34.647125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 358/733] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:34.648277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75a0bf-5307-4562-a218-b06c16b2b34e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:34.700966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.751317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.762301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75a0bf-5307-4562-a218-b06c16b2b34e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:34.775526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112331-1a9f-4106-a7dc-70867ab2ea17 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:34.799782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952c327-2ea0-4e8d-8c65-6b7d9c17677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:34.800463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952c327-2ea0-4e8d-8c65-6b7d9c17677e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.800771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952c327-2ea0-4e8d-8c65-6b7d9c17677e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.801082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952c327-2ea0-4e8d-8c65-6b7d9c17677e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.840510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068cacb-93ed-48a3-9d4f-3b2732a66f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:34.841149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068cacb-93ed-48a3-9d4f-3b2732a66f5d None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:34.841430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068cacb-93ed-48a3-9d4f-3b2732a66f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:34.841980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068cacb-93ed-48a3-9d4f-3b2732a66f5d None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:34.843668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068cacb-93ed-48a3-9d4f-3b2732a66f5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:34.845267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068cacb-93ed-48a3-9d4f-3b2732a66f5d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:34.891810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952c327-2ea0-4e8d-8c65-6b7d9c17677e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:34.893294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952c327-2ea0-4e8d-8c65-6b7d9c17677e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:34.940266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.991568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 376/734] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:50:34 2022] POST /identity/v3/services => generated 251 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:34.992399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068cacb-93ed-48a3-9d4f-3b2732a66f5d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.001673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 359/735] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:35.001673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952c327-2ea0-4e8d-8c65-6b7d9c17677e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.110965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952c327-2ea0-4e8d-8c65-6b7d9c17677e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:35.124756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068cacb-93ed-48a3-9d4f-3b2732a66f5d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:35.153405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:35.153646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ff124-e08e-43c0-8c4b-5dab371ba73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:35.154391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff124-e08e-43c0-8c4b-5dab371ba73e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.154683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff124-e08e-43c0-8c4b-5dab371ba73e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.154961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff124-e08e-43c0-8c4b-5dab371ba73e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.172719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129824c-c363-4e82-8428-4c0db215c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:35.173360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129824c-c363-4e82-8428-4c0db215c4ea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.174953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129824c-c363-4e82-8428-4c0db215c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.174953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129824c-c363-4e82-8428-4c0db215c4ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.181539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ff124-e08e-43c0-8c4b-5dab371ba73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:35.186758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129824c-c363-4e82-8428-4c0db215c4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7d4ff124-e08e-43c0-8c4b-5dab371ba73e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:35.188288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:35.189645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:35.190931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 360/736] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:35.192873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e285a-f103-4b7a-9236-b67ead7eed50 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.192873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e285a-f103-4b7a-9236-b67ead7eed50 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.192873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e285a-f103-4b7a-9236-b67ead7eed50 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5129824c-c363-4e82-8428-4c0db215c4ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:35.193142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:35.194196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:35.195014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 377/737] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:35.195743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 361/738] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:35.198915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129824c-c363-4e82-8428-4c0db215c4ea None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.199749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e285a-f103-4b7a-9236-b67ead7eed50 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.205468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:35.309533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129824c-c363-4e82-8428-4c0db215c4ea None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:35.315219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e285a-f103-4b7a-9236-b67ead7eed50 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:35.343958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:35.344629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.344918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.345199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.353670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aedf20-2683-40e8-b08c-f117e3b3ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:35.354933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf20-2683-40e8-b08c-f117e3b3ba0d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.355393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf20-2683-40e8-b08c-f117e3b3ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.355870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf20-2683-40e8-b08c-f117e3b3ba0d None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.356436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:35.356945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aedf20-2683-40e8-b08c-f117e3b3ba0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:35.357432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aedf20-2683-40e8-b08c-f117e3b3ba0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:35.357962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:35.359142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aedf20-2683-40e8-b08c-f117e3b3ba0d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:35.373152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 362/739] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:35.373352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:35.378884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:35.380136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:35.380136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:35.380136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:35.380352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fa0f8-7fec-4c69-aece-cce102b0aff4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.380352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fa0f8-7fec-4c69-aece-cce102b0aff4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.380524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 378/740] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:35.380598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fa0f8-7fec-4c69-aece-cce102b0aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.380684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.396222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0a3fa0f8-7fec-4c69-aece-cce102b0aff4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:35.397631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0a3fa0f8-7fec-4c69-aece-cce102b0aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:35.408450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:35.466242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:35.481191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 363/741] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:50:35.481191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fa0f8-7fec-4c69-aece-cce102b0aff4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.500801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950559a9-672f-43e0-9304-3be04229e5df None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:35.613416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:35.614498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.614991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.615474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.616447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:35.617074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:35.618741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:35.628166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 379/742] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:35.630184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.659417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fa0f8-7fec-4c69-aece-cce102b0aff4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:35.709177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:35.710163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.710667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.711153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.712190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:35.712653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:35.714095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:35.726181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 364/743] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:35.727535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.763823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:35.771350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfa6d4-cede-453e-818d-260439586d6b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:35.803133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:35.812488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:35.815069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.815785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.815785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.832764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:35.835233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:35.856901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:35.857918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:35.858825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:35.858825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:35.858825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:35.858996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29ca7-6a3d-4d5e-b102-ab2b5e30c5d7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:35.859071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 380/744] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:35.859154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.896714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:35.897270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:35.897550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:35.897824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:35.909246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:35.911116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:35.926992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:35.928157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:35.929477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:35.929477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:35.929477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:35.929477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 365/745] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:35.929477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:35.981838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494bb87-44b4-4863-bab9-b96b28f4bb7c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.017708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.018339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.018625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.018905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.025976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.027432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:36.039625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:36.040560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:36.041743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:36.041743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:36.041743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:36.041743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:36.041743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:36.041743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:36.041743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:36.041743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:36.045506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 381/746] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:36.046209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.049546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc447-f372-4ae0-8737-d7d5518c572e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.056603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.060342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.086525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b794ff-318f-471c-9209-289f84122c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.087408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b794ff-318f-471c-9209-289f84122c23 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.087689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b794ff-318f-471c-9209-289f84122c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.087977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b794ff-318f-471c-9209-289f84122c23 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.088646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b794ff-318f-471c-9209-289f84122c23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.090074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b794ff-318f-471c-9209-289f84122c23 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.151151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674a2c-d798-407c-9b23-a6c161f5bb60 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.184760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 366/747] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:50:35 2022] POST /identity/v3/services => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:36.185533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b794ff-318f-471c-9209-289f84122c23 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.214588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.215222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.215507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.215782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.216457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:36.216787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.218224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.247880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 382/748] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:36.247880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.325635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.358804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b794ff-318f-471c-9209-289f84122c23 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.375008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5f7a-3ba8-43af-9822-6a1ae18e666d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.409685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.411087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.411376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.411679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.412411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:36.412756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.414284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.425003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.425989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.427160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.427529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 367/749] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:36.428090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.428353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.429430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:36.429944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.432789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.449709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 383/750] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:36.450489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.467971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.568469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1e6b5-6616-4fe3-a97c-64d7f6981fc9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.576032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187026a-3a9e-46b8-a751-494196e59db6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.602850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.606791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.607681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.608144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.608625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.615982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.616725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.617007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.617285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.617844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.619517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.625709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.627262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:36.633223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:36.634224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:36.635194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:36.642103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:36.643494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:50:36.644455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:36.645912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 368/752] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:36.646984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.647879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 384/752] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:36.648866 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.743133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.755878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae83db6-b9b9-47ea-95fc-fb6916b6b00a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.768616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277687e-888d-4e52-94e4-7a10b0735c5b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.805124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.806595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.807064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.807547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.808461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ad6f1167ee1d479ab3c0a5a8d46d846d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:36.809007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.810641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.818638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.819235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.819442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.819645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 369/753] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/role_assignments?user.id=ad6f1167ee1d479ab3c0a5a8d46d846d&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:36.819766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.820465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:36.820821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:36.821431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.822283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:36.849237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 385/754] 10.222.0.75 () {56 vars in 1149 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:36.854688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:36.911792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:36.952328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b431de-bd4e-46ed-88e7-5c362faece15 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.980053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ac795-c001-4ac3-b4da-f2675d67ec6b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:36.997363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:36.998060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:36.998446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:36.998823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:36.999689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:37.000101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:37.002202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:37.022940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93b13-2653-4473-846e-b3c3962e2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:37.023837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93b13-2653-4473-846e-b3c3962e2b98 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.024268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93b13-2653-4473-846e-b3c3962e2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.024719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93b13-2653-4473-846e-b3c3962e2b98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.028553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 370/755] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:37.032374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:37.048355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:37.110197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93b13-2653-4473-846e-b3c3962e2b98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:37.111719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93b13-2653-4473-846e-b3c3962e2b98 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:37.159517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:37.165802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd847b-9003-45f1-9f84-f5a10c447796 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:37.215386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:37.217252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.217533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.217806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.230713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:37.232169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:37.240061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 386/756] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:50:37.247158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93b13-2653-4473-846e-b3c3962e2b98 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:37.255198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:37.256217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:37.257623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:37.257623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:37.257623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:37.257623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 371/757] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:37.262377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:37.353969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:37.368997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93b13-2653-4473-846e-b3c3962e2b98 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:37.403256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1073f-7696-457c-bb5a-46076620d931 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:37.415811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eeead-2de1-436e-a196-fb46a4965668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:37.417106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eeead-2de1-436e-a196-fb46a4965668 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.417106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eeead-2de1-436e-a196-fb46a4965668 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.417278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eeead-2de1-436e-a196-fb46a4965668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.427020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:37.430105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eeead-2de1-436e-a196-fb46a4965668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:37.431967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eeead-2de1-436e-a196-fb46a4965668 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:37.444381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7b7b-d109-4126-8b04-2fd816e1e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:37.445246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7b7b-d109-4126-8b04-2fd816e1e89d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.445706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7b7b-d109-4126-8b04-2fd816e1e89d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.446130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7b7b-d109-4126-8b04-2fd816e1e89d None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.446983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7b7b-d109-4126-8b04-2fd816e1e89d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:37.447449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7b7b-d109-4126-8b04-2fd816e1e89d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:37.449014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7b7b-d109-4126-8b04-2fd816e1e89d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-285eeead-2de1-436e-a196-fb46a4965668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:37.450719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:37.451905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:37.453042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:37.453042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:37.453042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:37.455329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 387/758] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:37.458321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72449cd-e29e-48d3-85bb-e3e8a6253769 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.458321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72449cd-e29e-48d3-85bb-e3e8a6253769 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.458321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72449cd-e29e-48d3-85bb-e3e8a6253769 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.460027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 388/759] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:37.460981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72449cd-e29e-48d3-85bb-e3e8a6253769 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:37.469068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 372/760] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:37.470608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11df83-a923-450d-9793-e0b880a0e9e0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.473664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11df83-a923-450d-9793-e0b880a0e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.473664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11df83-a923-450d-9793-e0b880a0e9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.492388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-df11df83-a923-450d-9793-e0b880a0e9e0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:37.493913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df11df83-a923-450d-9793-e0b880a0e9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:37.580130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 373/761] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:37.581570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11df83-a923-450d-9793-e0b880a0e9e0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:37.606022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72449cd-e29e-48d3-85bb-e3e8a6253769 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:37.643516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:37.651928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:37.652764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.653274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.653745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.654607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:37.655139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:37.656994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:37.673861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 389/762] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:37.683896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:37.703156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11df83-a923-450d-9793-e0b880a0e9e0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:37.742179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:37.742835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.743122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.743399 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.752916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:37.754329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:37.755978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:37.769325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:37.770459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:37.771524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:37.771524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:37.771524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:37.771524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:37.771524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:37.771524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:37.771524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:37.771524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:37.774792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 374/763] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:37.781889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:37.828663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6086ad0-59a0-433a-9911-973e5aedea33 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:37.882701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:37.883597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:37.884040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:37.884454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:37.892724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:37.894443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:37.916360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:37.917363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:37.918530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:37.918530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:37.918530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:37.918530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:37.918530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:37.918530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:37.918530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:37.918530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:37.920704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 390/764] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:37.933560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:37.989249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183369f-60cc-4761-954a-aaa8f88d116f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:38.020122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:38.068204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:38.069230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.069702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.070161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.071424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:38.071944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:38.074740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:38.094565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 375/765] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:38.094565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:38.121852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97774f-276e-4509-9f2e-ffc3631ca48d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:38.144088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:38.170394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:38.171177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.171627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.172018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.172876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:38.173286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:38.175195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:38.196628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 391/766] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:38.197733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:38.231980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2945-0b83-46ad-b7d1-4f77228d2108 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:38.275365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:38.276313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.276802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.277279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.278131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:38.279632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:38.292674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:38.293743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:38.294622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:38.297167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 376/767] 10.222.0.75 () {56 vars in 1129 bytes} [Mon Sep 19 14:50:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:38.298145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:38.336048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306ed9-1123-4305-a73f-e64cceae116a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:38.351166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:38.378006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb313675-4bee-44c8-8815-6a30e80b444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:38.379311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313675-4bee-44c8-8815-6a30e80b444d None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.380038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313675-4bee-44c8-8815-6a30e80b444d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.380595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313675-4bee-44c8-8815-6a30e80b444d None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ab4bb702760a4cd2b2cbf6f732b2360b/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.382938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb313675-4bee-44c8-8815-6a30e80b444d None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=ab4bb702760a4cd2b2cbf6f732b2360b, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:38.385905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb313675-4bee-44c8-8815-6a30e80b444d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:38.440096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5495d0-0ba2-4e67-b74a-f63f480eea90 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:38.476684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 392/768] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:50:38 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ab4bb702760a4cd2b2cbf6f732b2360b/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:50:38.478133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb313675-4bee-44c8-8815-6a30e80b444d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:38.505896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:38.507075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.507579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.508208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.509300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=0c8b9fb92f244a11a8dc082a9bee85f6) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:38.509886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:38.514816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:38.529791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 377/769] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:38 2022] GET /identity/v3/role_assignments?user.id=0c8b9fb92f244a11a8dc082a9bee85f6&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:38.592329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:38.726786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb313675-4bee-44c8-8815-6a30e80b444d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:38.803167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a6da-2839-4d14-b34e-398f9106b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:38.803795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a6da-2839-4d14-b34e-398f9106b910 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.804084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a6da-2839-4d14-b34e-398f9106b910 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.804372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a6da-2839-4d14-b34e-398f9106b910 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.805063 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a6da-2839-4d14-b34e-398f9106b910 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:38.805351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a6da-2839-4d14-b34e-398f9106b910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:38.806761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a6da-2839-4d14-b34e-398f9106b910 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:38.815229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 393/770] 10.222.0.75 () {56 vars in 1124 bytes} [Mon Sep 19 14:50:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:38.822606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:38.866652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d19ef-e712-46f4-b2a1-1f50b8eba3a4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.867715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d19ef-e712-46f4-b2a1-1f50b8eba3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.868190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d19ef-e712-46f4-b2a1-1f50b8eba3a4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.870066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 394/771] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:38.880037 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa1f3-5edc-4e75-9cdb-e33abb2b056b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:38.880655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa1f3-5edc-4e75-9cdb-e33abb2b056b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:38.881263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa1f3-5edc-4e75-9cdb-e33abb2b056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:38.901515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5eafa1f3-5edc-4e75-9cdb-e33abb2b056b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:38.903603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5eafa1f3-5edc-4e75-9cdb-e33abb2b056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:39.031611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 395/772] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:39.041361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:39.050890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8311146-8187-41d5-88e7-46983208a3eb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:39.105468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:39.106101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.106387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.106665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:39.107316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:39.107624 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:39.109024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:39.117489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 378/773] 10.222.0.75 () {56 vars in 1124 bytes} [Mon Sep 19 14:50:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:39.123024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa1f3-5edc-4e75-9cdb-e33abb2b056b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:39.160076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:39.247747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa1f3-5edc-4e75-9cdb-e33abb2b056b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:39.293389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:39.293941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.294225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.294497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:39.295208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] RBAC: Adding query filter params (interface=public, service_id=0478bdbc75c14d64978d0654c7d77683, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:39.295517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:39.296926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:39.305990 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 396/774] 10.222.0.75 () {56 vars in 1251 bytes} [Mon Sep 19 14:50:39 2022] GET /identity/v3/endpoints?service_id=0478bdbc75c14d64978d0654c7d77683&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:39.311199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:39.422204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:39.473063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c1062-ea7c-486d-b863-90942178c717 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:39.536275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b28c0-02ab-4752-9cba-6caa8aadf389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:39.537366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b28c0-02ab-4752-9cba-6caa8aadf389 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.537859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b28c0-02ab-4752-9cba-6caa8aadf389 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.538327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b28c0-02ab-4752-9cba-6caa8aadf389 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:39.539182 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b28c0-02ab-4752-9cba-6caa8aadf389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:39.540790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b28c0-02ab-4752-9cba-6caa8aadf389 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:39.550585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 379/775] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:50:39 2022] GET /identity/v3/services => generated 772 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:39.611255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:39.633604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dadb2-ab1d-4613-bbcb-a485825e40b8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:39.681195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a099bf3-306f-49dd-a85a-0d7e7eb1e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:39.681893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099bf3-306f-49dd-a85a-0d7e7eb1e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.682099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099bf3-306f-49dd-a85a-0d7e7eb1e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.682364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099bf3-306f-49dd-a85a-0d7e7eb1e3e0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:39.683007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099bf3-306f-49dd-a85a-0d7e7eb1e3e0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:39.684375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099bf3-306f-49dd-a85a-0d7e7eb1e3e0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0a099bf3-306f-49dd-a85a-0d7e7eb1e3e0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:39.700760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:39.701830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:39.702680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 397/776] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:39 2022] GET /identity/v3/services/network => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:39.708689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b28c0-02ab-4752-9cba-6caa8aadf389 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:39.754771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:39.862759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b28c0-02ab-4752-9cba-6caa8aadf389 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:39.903115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:39.903782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.904061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.904333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:39.905086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:39.905389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:39.906737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:39.916353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 380/777] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:50:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:39.917173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a72f2-ded6-41b0-9d93-5857a65498b1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.917629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a72f2-ded6-41b0-9d93-5857a65498b1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.917707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a72f2-ded6-41b0-9d93-5857a65498b1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:39.919014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 398/778] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:39.920131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:39.926472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a397-5993-431f-a418-e073e75626ef None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:39.927088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a397-5993-431f-a418-e073e75626ef None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:39.927581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a397-5993-431f-a418-e073e75626ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:40.028762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:40.042469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf224943-38da-454a-b82f-400b539d59b0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:40.099219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a187a397-5993-431f-a418-e073e75626ef None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:40.103436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a187a397-5993-431f-a418-e073e75626ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:40.114954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:40.115914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:40.116389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:40.116907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:40.117752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] RBAC: Adding query filter params (type=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:40.118250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:40.119796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:40.130553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 381/779] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:50:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:40.137308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:40.227179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 399/780] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:50:40.292413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a096b-16a8-4c54-8b61-d8a88305737b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:40.338211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:40.338833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:40.339112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:40.339381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:40.340085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] RBAC: Adding query filter params (interface=public, service_id=38ce68ed2952432a990d5f9e3d83c831, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:40.340395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:40.341784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:40.355287 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 382/781] 10.222.0.75 () {56 vars in 1251 bytes} [Mon Sep 19 14:50:40 2022] GET /identity/v3/endpoints?service_id=38ce68ed2952432a990d5f9e3d83c831&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:40.364913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a397-5993-431f-a418-e073e75626ef None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:40.474014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:40.490569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a397-5993-431f-a418-e073e75626ef None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:40.525971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4544f-a5af-4896-b522-29b697d81e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:40.526607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4544f-a5af-4896-b522-29b697d81e1d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:40.526900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4544f-a5af-4896-b522-29b697d81e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:40.527177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4544f-a5af-4896-b522-29b697d81e1d None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:40.527790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4544f-a5af-4896-b522-29b697d81e1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:40.529191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4544f-a5af-4896-b522-29b697d81e1d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:40.534776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 400/782] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:50:40 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:40.673736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:40.700785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:40.814771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98955a2e-78e5-4a36-93b1-c21412402128 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:40.854170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c35aab-7c87-4282-a9c3-2b782b75a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:40.854805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c35aab-7c87-4282-a9c3-2b782b75a300 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:40.855084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c35aab-7c87-4282-a9c3-2b782b75a300 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:40.855353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c35aab-7c87-4282-a9c3-2b782b75a300 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:40.866119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c35aab-7c87-4282-a9c3-2b782b75a300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c1c35aab-7c87-4282-a9c3-2b782b75a300 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:40.870913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:40.871834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:40.872681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 383/783] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:40.883360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4544f-a5af-4896-b522-29b697d81e1d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:41.036725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4544f-a5af-4896-b522-29b697d81e1d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:41.087403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc4c3c-df3e-45dc-85d1-89edaf5904c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:41.088022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc4c3c-df3e-45dc-85d1-89edaf5904c6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.088298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc4c3c-df3e-45dc-85d1-89edaf5904c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.088598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc4c3c-df3e-45dc-85d1-89edaf5904c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.089270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc4c3c-df3e-45dc-85d1-89edaf5904c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:41.089571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc4c3c-df3e-45dc-85d1-89edaf5904c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:41.090942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc4c3c-df3e-45dc-85d1-89edaf5904c6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:41.104838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 401/784] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:41.110838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c35aab-7c87-4282-a9c3-2b782b75a300 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:41.229511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:41.265935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c35aab-7c87-4282-a9c3-2b782b75a300 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:41.323241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:41.324277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.324809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.325295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.338153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:41.339606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:41.353446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e6d4-f56d-47f5-b0cb-ba51504e6117 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.353774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e6d4-f56d-47f5-b0cb-ba51504e6117 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.353985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e6d4-f56d-47f5-b0cb-ba51504e6117 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.355308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 402/785] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:41.360641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162751fe-26de-45d4-a151-3f27be6a5a19 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.360934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162751fe-26de-45d4-a151-3f27be6a5a19 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.361216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162751fe-26de-45d4-a151-3f27be6a5a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:41.367632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:41.368621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:41.369510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:41.369510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:41.369510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:41.369510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 384/786] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:41.375621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:41.381308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-162751fe-26de-45d4-a151-3f27be6a5a19 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:41.382552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-162751fe-26de-45d4-a151-3f27be6a5a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:41.385532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:41.454868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 403/787] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:50:41.491805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885911b1-37c0-42a7-934e-4da308a488a1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.492171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885911b1-37c0-42a7-934e-4da308a488a1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.492365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885911b1-37c0-42a7-934e-4da308a488a1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.494011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 404/788] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:50:41.501367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0576a8-d705-4fc8-9205-b91944f913bc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.501654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0576a8-d705-4fc8-9205-b91944f913bc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.501939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0576a8-d705-4fc8-9205-b91944f913bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.537585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-db0576a8-d705-4fc8-9205-b91944f913bc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:41.538807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-db0576a8-d705-4fc8-9205-b91944f913bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:41.541351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69649450-c71f-498f-b40c-93f365c7df38 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:41.589747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:41.600658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:41.601274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.601553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.601823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.602469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:41.602767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:41.604296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:41.622910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 385/789] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:41.628786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:41.670802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 405/790] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:41.762338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb75381-d795-457b-a175-af63372cfbb2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:41.804155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0576a8-d705-4fc8-9205-b91944f913bc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:41.824534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:41.824534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:41.824534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:41.824534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:41.836876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:41.838820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:41.864846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:41.865989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:41.866969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:41.876802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 386/791] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:41.881474 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:41.935863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:41.965188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.007439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0576a8-d705-4fc8-9205-b91944f913bc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.018420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d406d56-811b-4aa9-907a-889f44737d4a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.046941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dd786-03fc-4981-afee-45d8ec52bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.047629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd786-03fc-4981-afee-45d8ec52bad1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.047844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd786-03fc-4981-afee-45d8ec52bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.048114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd786-03fc-4981-afee-45d8ec52bad1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.059712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dd786-03fc-4981-afee-45d8ec52bad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:42.064174 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-313dd786-03fc-4981-afee-45d8ec52bad1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:42.065007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:42.065919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:42.067606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:42.069824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.070335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.070817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.071499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 406/792] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:42.071969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:42.072329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dd786-03fc-4981-afee-45d8ec52bad1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.072732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.074411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.104804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 387/793] 10.222.0.75 () {56 vars in 1135 bytes} [Mon Sep 19 14:50:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:42.106096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.197268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dd786-03fc-4981-afee-45d8ec52bad1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.216142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591ecd5-ed9e-4474-9b50-956f32aca1b5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.227796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.229601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.235910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df552201-ce3e-423d-a6f7-44be2e72a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.238953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df552201-ce3e-423d-a6f7-44be2e72a368 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.238953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df552201-ce3e-423d-a6f7-44be2e72a368 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.238953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df552201-ce3e-423d-a6f7-44be2e72a368 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.249393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df552201-ce3e-423d-a6f7-44be2e72a368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:42.252926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.253690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.254571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.254935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.255668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:42.256034 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-df552201-ce3e-423d-a6f7-44be2e72a368 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:42.256523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:42.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:42.258889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:42.259590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.266110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 407/794] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:42.267149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df552201-ce3e-423d-a6f7-44be2e72a368 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.273822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 388/795] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:42.274825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.378736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df552201-ce3e-423d-a6f7-44be2e72a368 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.398186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10f6e2-0ec3-41d1-b5e1-b5ed9d262d65 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.425192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4eded-35d6-44ce-a56a-19353297ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.426910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4eded-35d6-44ce-a56a-19353297ea6b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.433278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4eded-35d6-44ce-a56a-19353297ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.433278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4eded-35d6-44ce-a56a-19353297ea6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.437268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.438116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.438594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.439099 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.439962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:42.440459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.441228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4eded-35d6-44ce-a56a-19353297ea6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.443033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.443255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4eded-35d6-44ce-a56a-19353297ea6b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.457710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 389/796] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:42.457882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-eaa4eded-35d6-44ce-a56a-19353297ea6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:42.464434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:42.471068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 408/797] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745146a1-30b1-4076-9c46-a2033f91a9ba None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745146a1-30b1-4076-9c46-a2033f91a9ba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745146a1-30b1-4076-9c46-a2033f91a9ba None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 409/798] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:42.472181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745146a1-30b1-4076-9c46-a2033f91a9ba None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.503599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.525135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.575474 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e744c-47ea-4f6a-a735-5655ef396028 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.588075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745146a1-30b1-4076-9c46-a2033f91a9ba None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.613081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcec662-eaeb-40ac-b054-72a8c34e2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.614220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcec662-eaeb-40ac-b054-72a8c34e2353 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.614508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcec662-eaeb-40ac-b054-72a8c34e2353 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.614777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcec662-eaeb-40ac-b054-72a8c34e2353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.624712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.625171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.625451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.625723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.626833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcec662-eaeb-40ac-b054-72a8c34e2353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.628274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcec662-eaeb-40ac-b054-72a8c34e2353 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.637697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.639187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4bcec662-eaeb-40ac-b054-72a8c34e2353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:42.644319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:42.645491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:42.646375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:42.646375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:42.646375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:42.646375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 390/799] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:42.647578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde21b4-86b4-415c-9e9d-f2bafaceed24 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.647578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde21b4-86b4-415c-9e9d-f2bafaceed24 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.647768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde21b4-86b4-415c-9e9d-f2bafaceed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:42.658431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:42.659398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:42.660347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:42.660347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:42.660347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:42.660347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 410/800] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:42.660347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.668793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4cde21b4-86b4-415c-9e9d-f2bafaceed24 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:42.669989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4cde21b4-86b4-415c-9e9d-f2bafaceed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:42.745373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 391/801] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:42.746153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde21b4-86b4-415c-9e9d-f2bafaceed24 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.777007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.779303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:42.787541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd3e50-1e39-4c68-81b0-38d9153afe56 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.823267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.824733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.825224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.825764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.827074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:42.827613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.829251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.848264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 411/802] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:42.849502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.865793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde21b4-86b4-415c-9e9d-f2bafaceed24 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:42.905449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:42.906067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:42.906345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:42.906762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:42.907425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:42.907730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:42.909419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:42.932646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 392/803] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:42.933947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:42.976419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c469e-a66b-4eff-abf2-b7024d0d9868 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.017908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.019004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.020129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.020668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.021581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:43.022218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.023954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.027737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:43.039769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 412/804] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:43.041296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.056427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd80b-a010-4f6a-ba71-3f2599a05742 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.059682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:43.094951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.095586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.095867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.096142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.104731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.106269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:43.118618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:43.119530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:43.120390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 393/805] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:43.121406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.151109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b4a2c-1713-4cf5-91d3-81f27262fccd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.185240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.185870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.186156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.186423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.195137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.196603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:43.208202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:43.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:50:43.210273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:43.213076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 413/806] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:43.213796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.230959 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9851dcc-5938-4a56-ace1-c99c2a216ade None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.265618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.266257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.266536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.266810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.269657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:43.274856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.282432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:43.287524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:43.288446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 394/807] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:43.289447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.291515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:43.316149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bac559-8117-43e9-8261-4a4b5ea1aaff None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.350568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a855b-a968-4273-a3c0-e97b4183a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.351201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a855b-a968-4273-a3c0-e97b4183a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.351487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a855b-a968-4273-a3c0-e97b4183a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.351795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a855b-a968-4273-a3c0-e97b4183a5c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.352379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a855b-a968-4273-a3c0-e97b4183a5c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.353790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a855b-a968-4273-a3c0-e97b4183a5c3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c61a855b-a968-4273-a3c0-e97b4183a5c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:43.362496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:43.364145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:43.365157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 414/808] 10.222.0.75 () {56 vars in 1129 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:43.365945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92838543-d63a-4574-b379-7ee959293ab0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.366358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92838543-d63a-4574-b379-7ee959293ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.366358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92838543-d63a-4574-b379-7ee959293ab0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.372069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 415/809] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:43.372069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92838543-d63a-4574-b379-7ee959293ab0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.396742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e2202-8cff-4630-9f61-2ac5b964fb6b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.434480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.435098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.435381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.435658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.436357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:43.436710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.438155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.451432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 395/810] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:43.452308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.484149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92838543-d63a-4574-b379-7ee959293ab0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.518450 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:43.528513 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.528513 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.528851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.528959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.529679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:43.529984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.531434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.541632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:43.552167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 416/811] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:43.557160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.566598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8945-e115-400a-ba6d-018dc516f69a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.604097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d6ef-d1e8-4b8b-90f9-6cf3b68ef5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.604736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d6ef-d1e8-4b8b-90f9-6cf3b68ef5ae None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.605021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d6ef-d1e8-4b8b-90f9-6cf3b68ef5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.605296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d6ef-d1e8-4b8b-90f9-6cf3b68ef5ae None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.606202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26d6ef-d1e8-4b8b-90f9-6cf3b68ef5ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:43.606527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26d6ef-d1e8-4b8b-90f9-6cf3b68ef5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.608366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26d6ef-d1e8-4b8b-90f9-6cf3b68ef5ae None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.637815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 396/812] 10.222.0.75 () {56 vars in 1149 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:43.639121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48dd5f-d131-4125-98c5-9a71c48560a7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.639414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48dd5f-d131-4125-98c5-9a71c48560a7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.639701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48dd5f-d131-4125-98c5-9a71c48560a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.658954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-be48dd5f-d131-4125-98c5-9a71c48560a7 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:43.661186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-be48dd5f-d131-4125-98c5-9a71c48560a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:43.674303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5415e-fadd-405b-96a1-bfc17553a2f6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.714135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.714742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.715020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.715291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.715924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:43.716227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.717689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.723318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 417/813] 10.222.0.75 () {56 vars in 1124 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:43.724094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.757342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 397/814] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:43.758215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48dd5f-d131-4125-98c5-9a71c48560a7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:43.798926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:43.815125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:43.846248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7e2a4-b599-47e7-a18f-915d2e6146f4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.890185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cecf82-28e8-4893-9d0d-452bc439b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.890854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cecf82-28e8-4893-9d0d-452bc439b568 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.891131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cecf82-28e8-4893-9d0d-452bc439b568 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.891404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cecf82-28e8-4893-9d0d-452bc439b568 None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ad6f1167ee1d479ab3c0a5a8d46d846d/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:43.891745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48dd5f-d131-4125-98c5-9a71c48560a7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:43.893717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cecf82-28e8-4893-9d0d-452bc439b568 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=ad6f1167ee1d479ab3c0a5a8d46d846d, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:43.895563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cecf82-28e8-4893-9d0d-452bc439b568 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:43.932653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e446a1e-d533-4956-9759-ef7419657ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:43.933279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e446a1e-d533-4956-9759-ef7419657ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:43.933562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e446a1e-d533-4956-9759-ef7419657ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:43.933835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e446a1e-d533-4956-9759-ef7419657ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.006821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e446a1e-d533-4956-9759-ef7419657ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.008282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e446a1e-d533-4956-9759-ef7419657ad9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.032957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 418/815] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:50:43 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ad6f1167ee1d479ab3c0a5a8d46d846d/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:50:44.032957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cecf82-28e8-4893-9d0d-452bc439b568 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.062483 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.135182 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 398/816] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:50:44.136244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e446a1e-d533-4956-9759-ef7419657ad9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.181920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cecf82-28e8-4893-9d0d-452bc439b568 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:44.209226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.231429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:44.232078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:44.232351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:44.232672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.245459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.247388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:44.263729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:44.264917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:44.265859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:44.265859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:44.265859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:44.265859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 419/817] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:44.266091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.272794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e446a1e-d533-4956-9759-ef7419657ad9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:44.309297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:44.309829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:44.310107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:44.310379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.311017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:44.311315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.312733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.319961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 399/818] 10.222.0.75 () {56 vars in 1124 bytes} [Mon Sep 19 14:50:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:44.321435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.334498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.387883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9555244-1ba7-4d67-be20-a8f5b5314053 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:44.426648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:44.427557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:44.428084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:44.428362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] PATH_INFO: `/v3/services/network` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.428997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.430429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.434812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abafcd5-c2c9-4d0f-8569-e0473203ec53 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:44.439650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:44.442096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:44.443624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 420/819] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:44 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:44.444585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.480357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:44.481078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:44.481362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:44.481679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.489950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.494787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.496324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:44.514333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:44.515397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:44.516407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:44.516407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:44.516407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:44.516407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 400/820] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:44.516407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.581655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1555dac-80a0-460c-bc06-661f131f965b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:44.597442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.626077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:44.630798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:44.630798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:44.630798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.630798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:44.630798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.630798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.644086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 421/821] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:44.646152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.654177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cce700-7717-4b69-a0af-9484696ecf72 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:44.698608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a033be-196e-4761-b171-fbf4318d9251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:44.699508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a033be-196e-4761-b171-fbf4318d9251 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:44.699788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a033be-196e-4761-b171-fbf4318d9251 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:44.700062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a033be-196e-4761-b171-fbf4318d9251 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.700776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a033be-196e-4761-b171-fbf4318d9251 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.702163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a033be-196e-4761-b171-fbf4318d9251 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.747978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:44.755728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dce18b-8d17-429c-a723-1a4f7386b540 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:44.793919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:44.794547 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:44.794844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:44.795098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:44.795742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:44.796118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:44.797560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:44.808622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 422/822] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:50:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:44.808622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.808906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 401/823] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:50:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:44.809909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a033be-196e-4761-b171-fbf4318d9251 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:44.953009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13a173-0cf5-4330-892d-0fc7853c0fe0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.004064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.004818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.005102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.005539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.007363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:45.009205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.012017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:45.018383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a033be-196e-4761-b171-fbf4318d9251 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.030173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 423/824] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:45.031063 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:45.046713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.058746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.079055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.079440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.079732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.080013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.089975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.091427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:45.105430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:45.106378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:45.107261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 402/825] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:45.108581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:45.182371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bc46d-c7a5-40be-af86-de6e54942ae9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.230613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.231165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.231451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.231730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.232313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1fc2a-6042-4164-9054-e3f99ea34ccd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.232427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:45.232708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.234429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:45.242742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 424/826] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:50:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:45.244189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:45.281908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.283002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.283289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.283883 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.292977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.294447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:45.308384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:45.309360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:45.310242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:45.310242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:45.310242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:45.310242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:45.310242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:45.310242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:45.310242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:45.310242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:45.310670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 403/827] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:45.316527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:45.357141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.360103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.381528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da65f5-119e-4d38-bcee-48a33132c3b9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.418543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.419188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.419570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.419947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.420806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:45.421216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.422961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:45.440677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 425/828] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:45.440677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:45.454258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765f5ac-437d-45b1-ab87-9c5df4268e88 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.503853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e069b-4d48-4813-9044-aa9cbb73a333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.505008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e069b-4d48-4813-9044-aa9cbb73a333 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.505501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e069b-4d48-4813-9044-aa9cbb73a333 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.505983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e069b-4d48-4813-9044-aa9cbb73a333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.507076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e069b-4d48-4813-9044-aa9cbb73a333 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.509090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e069b-4d48-4813-9044-aa9cbb73a333 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:45.565474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6159-4d9d-4a82-a89b-0049de18837f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.601529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.602141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.602416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.602681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.603380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:45.603680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.605131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:45.616427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.628657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 426/829] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:45.628657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:45.629738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 404/830] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:50:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:45.639248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e069b-4d48-4813-9044-aa9cbb73a333 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:45.845614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:45.868876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e069b-4d48-4813-9044-aa9cbb73a333 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.872443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e3bdb-8e61-46ea-98dd-15c7e03d4fff None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:45.917295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a7910-81e0-4881-ba39-c9eae87e0dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.917925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7910-81e0-4881-ba39-c9eae87e0dbb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.918203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7910-81e0-4881-ba39-c9eae87e0dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.918479 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7910-81e0-4881-ba39-c9eae87e0dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.919412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a7910-81e0-4881-ba39-c9eae87e0dbb None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ab4bb702760a4cd2b2cbf6f732b2360b) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:45.919723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a7910-81e0-4881-ba39-c9eae87e0dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.920385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05861a19-7b7b-4b14-9024-62ba20daa651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:45.921087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861a19-7b7b-4b14-9024-62ba20daa651 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:45.921354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a7910-81e0-4881-ba39-c9eae87e0dbb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:45.921462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861a19-7b7b-4b14-9024-62ba20daa651 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:45.921629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861a19-7b7b-4b14-9024-62ba20daa651 None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/0c8b9fb92f244a11a8dc082a9bee85f6/roles/d080aeef5e23467ba4a98bd13261f353` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:45.929495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 405/831] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:45 2022] GET /identity/v3/role_assignments?user.id=ab4bb702760a4cd2b2cbf6f732b2360b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:45.943295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05861a19-7b7b-4b14-9024-62ba20daa651 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=0c8b9fb92f244a11a8dc082a9bee85f6, role_id=d080aeef5e23467ba4a98bd13261f353)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:45.944844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05861a19-7b7b-4b14-9024-62ba20daa651 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:46.043191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 427/832] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:50:45 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/0c8b9fb92f244a11a8dc082a9bee85f6/roles/d080aeef5e23467ba4a98bd13261f353 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:50:46.336569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd705-823f-4ae9-b24b-1303ea3f1596 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:46.337532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd705-823f-4ae9-b24b-1303ea3f1596 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:46.337532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd705-823f-4ae9-b24b-1303ea3f1596 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:46.338962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 406/833] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:46.344797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fe6d-b88b-4cad-8778-949506d21aa9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:46.345388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fe6d-b88b-4cad-8778-949506d21aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:46.345388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fe6d-b88b-4cad-8778-949506d21aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:46.365182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0951fe6d-b88b-4cad-8778-949506d21aa9 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:46.366453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0951fe6d-b88b-4cad-8778-949506d21aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:46.417501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:46.451188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 428/834] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:46.728781 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bd705-823f-4ae9-b24b-1303ea3f1596 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:46.846737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bd705-823f-4ae9-b24b-1303ea3f1596 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:46.883946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8b8d3-a7eb-4094-b4d2-5f50850d931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:46.884731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8b8d3-a7eb-4094-b4d2-5f50850d931a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:46.885013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8b8d3-a7eb-4094-b4d2-5f50850d931a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:46.885288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8b8d3-a7eb-4094-b4d2-5f50850d931a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:46.897808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8b8d3-a7eb-4094-b4d2-5f50850d931a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-27b8b8d3-a7eb-4094-b4d2-5f50850d931a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:46.902753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:46.903665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:46.904692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 407/835] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:46.909969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951fe6d-b88b-4cad-8778-949506d21aa9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:47.027836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951fe6d-b88b-4cad-8778-949506d21aa9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:47.069500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:47.070119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.070398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.070669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.071337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:47.071667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:47.073072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:47.082633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 429/836] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:47.088800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8b8d3-a7eb-4094-b4d2-5f50850d931a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:47.104383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:47.204245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8b8d3-a7eb-4094-b4d2-5f50850d931a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:47.241534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63713c-95b7-49eb-9613-1dcc75f798aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:47.242166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63713c-95b7-49eb-9613-1dcc75f798aa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.242443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63713c-95b7-49eb-9613-1dcc75f798aa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.242712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63713c-95b7-49eb-9613-1dcc75f798aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.253376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63713c-95b7-49eb-9613-1dcc75f798aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:47.254905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63713c-95b7-49eb-9613-1dcc75f798aa None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fc63713c-95b7-49eb-9613-1dcc75f798aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:47.272518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:47.273535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:47.274409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:47.274409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:47.274409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:47.274409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 408/837] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:47.282602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:47.302617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528c47-3353-4618-b441-9c26f9be47fa None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.303206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528c47-3353-4618-b441-9c26f9be47fa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.303613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528c47-3353-4618-b441-9c26f9be47fa None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.308607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 409/838] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:50:47.311139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3539f-d325-4365-9cdf-a244d96d4676 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.311522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3539f-d325-4365-9cdf-a244d96d4676 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.311886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3539f-d325-4365-9cdf-a244d96d4676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.333779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-23b3539f-d325-4365-9cdf-a244d96d4676 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:47.335111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-23b3539f-d325-4365-9cdf-a244d96d4676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:47.341746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:47.414284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17fa4-3f01-4362-8a0b-543135c04ff7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:47.459448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:47.460205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.460698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.461147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.462246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:47.462720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:47.464379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:47.479500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 430/839] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:47.488548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:47.525903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:47.557807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 410/840] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:47.602111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f51526-6907-4dcf-8b93-85ac6a45d2de None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:47.603745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:47.637897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:47.638732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.639022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.639299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.648316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:47.649810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:47.670459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:47.671690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:47.673079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 431/841] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:50:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:47.678367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3539f-d325-4365-9cdf-a244d96d4676 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:47.803148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3539f-d325-4365-9cdf-a244d96d4676 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:47.840444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:47.841487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:47.841973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:47.842449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:47.843400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:47.843919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:47.845621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:47.855818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:47.867059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 411/842] 10.222.0.75 () {56 vars in 1135 bytes} [Mon Sep 19 14:50:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:47.873652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:47.949584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:48.000919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01e9e7-95ca-4cda-855b-59f8265ca0a9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:48.013011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4949d9-3579-4473-a525-db23cb973cb8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:48.044236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd822-cff9-4021-a45f-de39dd00578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:48.045409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd822-cff9-4021-a45f-de39dd00578f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.045879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd822-cff9-4021-a45f-de39dd00578f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.046551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd822-cff9-4021-a45f-de39dd00578f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.057034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:48.057857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.058239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.058958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.059294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:48.060855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:48.070596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:48.071865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:48.072966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:48.079536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 432/843] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:48.080589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:48.114438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:48.144178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd822-cff9-4021-a45f-de39dd00578f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:48.147035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd822-cff9-4021-a45f-de39dd00578f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:48.201464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de666e-a83c-4ee0-97f2-5d693dad4887 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:48.223806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:48.263582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:48.264043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.264436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.264873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.265648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:48.266220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:48.267772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:48.280888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 433/844] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:48.282019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:48.306662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 412/845] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:50:48.313646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd822-cff9-4021-a45f-de39dd00578f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:48.404419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:48.416744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f7ac2-06e2-43af-a264-8eea0d7379d9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:48.442367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd822-cff9-4021-a45f-de39dd00578f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:48.454741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73b013-cca7-43c2-94c7-12f027f62907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:48.455351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b013-cca7-43c2-94c7-12f027f62907 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.455630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b013-cca7-43c2-94c7-12f027f62907 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.455901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b013-cca7-43c2-94c7-12f027f62907 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.456565 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73b013-cca7-43c2-94c7-12f027f62907 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:48.457600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73b013-cca7-43c2-94c7-12f027f62907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:48.459031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73b013-cca7-43c2-94c7-12f027f62907 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:48.464249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 434/846] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:48.465915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d4ba-9431-42ac-ab68-deb054091681 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.466203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d4ba-9431-42ac-ab68-deb054091681 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.466476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d4ba-9431-42ac-ab68-deb054091681 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.472440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 435/847] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:48.472440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b8be-36c5-4b95-9f21-7074576c1f81 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.472440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b8be-36c5-4b95-9f21-7074576c1f81 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.472440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b8be-36c5-4b95-9f21-7074576c1f81 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.476918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 436/848] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:48.476918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978b7a8-c5c2-4e89-b55e-707d8ddf8226 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.476918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978b7a8-c5c2-4e89-b55e-707d8ddf8226 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.476918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978b7a8-c5c2-4e89-b55e-707d8ddf8226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.482492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ef2e9-1be6-4941-bc3f-2eff1994a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:48.483155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef2e9-1be6-4941-bc3f-2eff1994a03c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.483437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef2e9-1be6-4941-bc3f-2eff1994a03c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.483711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef2e9-1be6-4941-bc3f-2eff1994a03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.495311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ef2e9-1be6-4941-bc3f-2eff1994a03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:48.496858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ef2e9-1be6-4941-bc3f-2eff1994a03c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:48.500110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0978b7a8-c5c2-4e89-b55e-707d8ddf8226 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:48.501698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0978b7a8-c5c2-4e89-b55e-707d8ddf8226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6b3ef2e9-1be6-4941-bc3f-2eff1994a03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:48.515570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:48.516649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:48.517572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:48.517572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:48.517572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:48.517572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 413/849] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:48.518392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d69f-500d-42fb-8727-5795a2db8f27 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.518392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d69f-500d-42fb-8727-5795a2db8f27 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.518803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143d69f-500d-42fb-8727-5795a2db8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.528082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:48.541539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4143d69f-500d-42fb-8727-5795a2db8f27 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:48.543600 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4143d69f-500d-42fb-8727-5795a2db8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:48.598948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 437/850] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:48.600782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978b7a8-c5c2-4e89-b55e-707d8ddf8226 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:48.638144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 414/851] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:48.704368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:48.722104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978b7a8-c5c2-4e89-b55e-707d8ddf8226 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:48.765705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:48.766339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.766625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.766903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.767635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:48.767998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:48.770060 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:48.783204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 438/852] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:48.789019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143d69f-500d-42fb-8727-5795a2db8f27 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:48.876084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:48.898604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143d69f-500d-42fb-8727-5795a2db8f27 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:48.935808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:48.936644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:48.936934 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:48.937208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:48.939612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:48.947333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:48.952875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:48.963549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:48.964601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 415/853] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:48.965758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.003538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5528658-c873-431a-8780-c06b02b93043 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.044683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.045320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.045598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.045897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.046456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.047852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:49.057538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:49.058517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:49.060000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 439/854] 10.222.0.75 () {56 vars in 1132 bytes} [Mon Sep 19 14:50:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:49.060993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.074462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:49.096086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d8573-92c7-4a10-b81c-8f29c378fdc3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.134336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a38b-ffc6-43b6-ba73-e63191a5e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.134976 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a38b-ffc6-43b6-ba73-e63191a5e73a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.135261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a38b-ffc6-43b6-ba73-e63191a5e73a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.135539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52a38b-ffc6-43b6-ba73-e63191a5e73a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.146807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52a38b-ffc6-43b6-ba73-e63191a5e73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-da52a38b-ffc6-43b6-ba73-e63191a5e73a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:49.152088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:49.153217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:49.154057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 416/855] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:49.154745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a38b-ffc6-43b6-ba73-e63191a5e73a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.183360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ba04-691f-4d04-aaeb-50725ae11365 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.220039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.220695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.220978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.221378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.222012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:49.222264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:49.222600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.224206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.242116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 440/856] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:49.242116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.284499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52a38b-ffc6-43b6-ba73-e63191a5e73a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.327797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:49.328268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.329075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.329288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.329562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.330551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:49.330860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.333029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.338192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 417/857] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:49.338888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.371457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7029fa-5c90-4866-b9cd-868970f04bd1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.407827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.408496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.408830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.409111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.409788 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:49.410126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.411514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.420687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 441/858] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:49.421726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.463271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd35980-d532-418e-9b09-db7a3d50d147 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.481946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:49.500626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.502670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.502670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.502670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.502670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ad6f1167ee1d479ab3c0a5a8d46d846d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:49.502670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.505532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.511051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 418/859] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/role_assignments?user.id=ad6f1167ee1d479ab3c0a5a8d46d846d&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:49.511929 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.563584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c653b7b-eaea-485f-8027-e4a3d740125b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.611138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:49.619306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.620315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.620842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.621325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.622302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:49.627402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.627402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.631497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 442/860] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:49.647014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1872714-9fce-492e-a839-6f6c19d86719 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.691000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.691941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.692319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.692633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.705576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.707230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:49.724612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:49.725645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:49.726546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:49.726546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:49.726546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:49.726546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 419/861] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:49.731883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.861993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b0844-0771-4f6d-8962-143341a87b5b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:49.903397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:49.904015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:49.904295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:49.904586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:49.905244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:49.905580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:49.907022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:49.920237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 443/862] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:49.926744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:49.967637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:50.041482 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381c2f-531e-4d27-bd84-afc4ad63e791 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:50.083584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:50.084232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:50.084585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:50.084919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:50.095514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:50.095514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:50.107160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:50.108341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:50:50.109512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:50.111792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 420/863] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:50:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:50.117860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:50.179264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:50.226550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bdb7f-314b-4062-aa68-3c958d402c62 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:50.267178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:50.267795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:50.268081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:50.268360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:50.269677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:50.270120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:50.271825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:50.292059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 444/864] 10.222.0.75 () {56 vars in 1149 bytes} [Mon Sep 19 14:50:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:50.297482 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:50.402241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:50.409672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397f9d1-7e0b-492d-aab0-1cc3f68f830d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:50.448723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2ba8-7933-41c2-a929-89a4d7ac595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:50.450167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2ba8-7933-41c2-a929-89a4d7ac595e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:50.450888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2ba8-7933-41c2-a929-89a4d7ac595e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:50.451426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2ba8-7933-41c2-a929-89a4d7ac595e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:50.526453 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2ba8-7933-41c2-a929-89a4d7ac595e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:50.528230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2ba8-7933-41c2-a929-89a4d7ac595e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:50.630714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:50.638426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 421/865] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:50:50.644507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:50.781803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889b9ac-236b-4e57-b39e-9631c4a9719f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:50.797556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:50.813455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47699c91-c3ba-468b-b167-b5686ba8f8c8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:50.813971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47699c91-c3ba-468b-b167-b5686ba8f8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:50.814049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47699c91-c3ba-468b-b167-b5686ba8f8c8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:50.816779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 422/866] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:50:50.820884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1b5d7-538f-4951-b9f1-239658f458fb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:50.821175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1b5d7-538f-4951-b9f1-239658f458fb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:50.821456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1b5d7-538f-4951-b9f1-239658f458fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:50.823433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:50.824302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:50.824951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:50.825530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:50.838432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:50.840250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:50.841702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b3c1b5d7-538f-4951-b9f1-239658f458fb None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:50.843023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b3c1b5d7-538f-4951-b9f1-239658f458fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:50.861601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:50.862623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:50.863573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:50.863573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:50.863573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:50.866424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 445/867] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:50.875736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:50.964735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 423/868] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:50:51.062669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278e771-834a-4c97-98be-e318b16fdeb3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:51.127198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:51.129214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.129902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.130576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.131987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:51.132766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:51.135451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:51.158675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 446/869] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:51.167422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1b5d7-538f-4951-b9f1-239658f458fb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:51.290018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1b5d7-538f-4951-b9f1-239658f458fb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:51.315324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:51.326926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:51.327567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.327846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.328119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.336583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:51.339220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:51.352926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:51.354168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:51.355406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 424/870] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:51.360518 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:51.388375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:51.396910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:51.486861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1175a-d505-4d9a-90f7-69967cac7850 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:51.545289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23ab3a-a9c6-4994-b606-6089dc6208e8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:51.547805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:51.548426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.548747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.549015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.549781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:51.550077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:51.552118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:51.570914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 447/871] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:51.572797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:51.593574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc5ddd-4146-4808-8c52-4b849ffa653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:51.594195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5ddd-4146-4808-8c52-4b849ffa653d None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.594478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5ddd-4146-4808-8c52-4b849ffa653d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.594750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5ddd-4146-4808-8c52-4b849ffa653d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.595417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc5ddd-4146-4808-8c52-4b849ffa653d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:51.596942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc5ddd-4146-4808-8c52-4b849ffa653d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:51.664727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:51.681323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba2348-fa72-49e9-9ef4-4df7cd1c323a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:51.722707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 425/872] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:50:51 2022] POST /identity/v3/services => generated 251 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:50:51.751878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7b35a-a1ac-4cba-98ea-1dba10208b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:51.751878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7b35a-a1ac-4cba-98ea-1dba10208b58 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.751878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7b35a-a1ac-4cba-98ea-1dba10208b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.751878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7b35a-a1ac-4cba-98ea-1dba10208b58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.752800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7b35a-a1ac-4cba-98ea-1dba10208b58 None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=0c8b9fb92f244a11a8dc082a9bee85f6) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:51.752800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7b35a-a1ac-4cba-98ea-1dba10208b58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:51.753321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7b35a-a1ac-4cba-98ea-1dba10208b58 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:51.761599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 448/873] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:51 2022] GET /identity/v3/role_assignments?user.id=0c8b9fb92f244a11a8dc082a9bee85f6&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:51.968119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392033f-b3bd-4ded-bd15-d2ce3ee407a1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.968119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392033f-b3bd-4ded-bd15-d2ce3ee407a1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.968119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392033f-b3bd-4ded-bd15-d2ce3ee407a1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.969043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 426/874] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:51.974324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec03d-b525-4378-9d09-e25149ec67d0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:51.974607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec03d-b525-4378-9d09-e25149ec67d0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:51.974878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec03d-b525-4378-9d09-e25149ec67d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:51.994991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c4aec03d-b525-4378-9d09-e25149ec67d0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:51.996276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c4aec03d-b525-4378-9d09-e25149ec67d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:52.024035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbccaf-3eaf-480e-ab91-a1ed68b9151c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:52.024339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbccaf-3eaf-480e-ab91-a1ed68b9151c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:52.024612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbccaf-3eaf-480e-ab91-a1ed68b9151c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:52.026029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 427/875] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:52.031188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5e1b-75db-42b3-895b-53a45dbcbb25 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:52.031498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5e1b-75db-42b3-895b-53a45dbcbb25 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:52.031776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5e1b-75db-42b3-895b-53a45dbcbb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:52.051732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c31a5e1b-75db-42b3-895b-53a45dbcbb25 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:52.052992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c31a5e1b-75db-42b3-895b-53a45dbcbb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:52.085474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 449/876] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:52.109038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:52.139551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 428/877] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:52 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:52.376811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aec03d-b525-4378-9d09-e25149ec67d0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:52.413989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a5e1b-75db-42b3-895b-53a45dbcbb25 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:52.465451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:52.492773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aec03d-b525-4378-9d09-e25149ec67d0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:52.530890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:52.531538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:52.531821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:52.532098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:52.532744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:52.535857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:52.547321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a5e1b-75db-42b3-895b-53a45dbcbb25 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:52.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:52.549489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:50:52.550359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:52.551742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 450/878] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:50:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:52.556895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:52.599082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77f844-1a93-4352-a1f4-874d27d8334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:52.599826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77f844-1a93-4352-a1f4-874d27d8334e None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:52.600240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77f844-1a93-4352-a1f4-874d27d8334e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:52.600543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77f844-1a93-4352-a1f4-874d27d8334e None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:52.601503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77f844-1a93-4352-a1f4-874d27d8334e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:52.603566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77f844-1a93-4352-a1f4-874d27d8334e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:52.680525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6d6e-69d7-4109-a9e1-438fdd4a4db9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:52.708929 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 429/879] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:50:52 2022] POST /identity/v3/services => generated 269 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:52.732608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27abbf-37f1-4843-8198-77f5591018b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:52.733624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27abbf-37f1-4843-8198-77f5591018b2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:52.734160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27abbf-37f1-4843-8198-77f5591018b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:52.734684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27abbf-37f1-4843-8198-77f5591018b2 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:52.735559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27abbf-37f1-4843-8198-77f5591018b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:52.736136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27abbf-37f1-4843-8198-77f5591018b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:52.737897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27abbf-37f1-4843-8198-77f5591018b2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:52.739761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:52.745758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 451/880] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:50:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:52.751219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77f844-1a93-4352-a1f4-874d27d8334e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:52.799699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:52.878827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77f844-1a93-4352-a1f4-874d27d8334e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:52.915644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22097222-374f-4128-9116-14d0ad851d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:52.916305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097222-374f-4128-9116-14d0ad851d27 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:52.916620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097222-374f-4128-9116-14d0ad851d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:52.916948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097222-374f-4128-9116-14d0ad851d27 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:52.917588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097222-374f-4128-9116-14d0ad851d27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:52.917949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097222-374f-4128-9116-14d0ad851d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:52.919425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097222-374f-4128-9116-14d0ad851d27 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:52.924311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 430/881] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:50:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:54.092985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5fb8-1d1a-4cba-b42a-f9ef3aec09fd None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.094013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5fb8-1d1a-4cba-b42a-f9ef3aec09fd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.094490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e5fb8-1d1a-4cba-b42a-f9ef3aec09fd None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.096312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 452/882] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:54.102370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3ad5-cce5-44f3-bc4c-4cd10e688d19 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.102832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3ad5-cce5-44f3-bc4c-4cd10e688d19 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.102911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3ad5-cce5-44f3-bc4c-4cd10e688d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.122981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-656e3ad5-cce5-44f3-bc4c-4cd10e688d19 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:54.124149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-656e3ad5-cce5-44f3-bc4c-4cd10e688d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:54.184980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846fdd-d978-482e-8eb8-803d98980c3c None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.185911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846fdd-d978-482e-8eb8-803d98980c3c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.186393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846fdd-d978-482e-8eb8-803d98980c3c None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.188595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 453/883] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:50:54.194149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af317-cf30-4d9c-97fd-3589179b30d8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.194729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af317-cf30-4d9c-97fd-3589179b30d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.195225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af317-cf30-4d9c-97fd-3589179b30d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.201480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 431/884] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:50:54.214474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d61af317-cf30-4d9c-97fd-3589179b30d8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:54.215966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d61af317-cf30-4d9c-97fd-3589179b30d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:54.287926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 454/885] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:50:54.472985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3ad5-cce5-44f3-bc4c-4cd10e688d19 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:54.502319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:54.565374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af317-cf30-4d9c-97fd-3589179b30d8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:54.585889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3ad5-cce5-44f3-bc4c-4cd10e688d19 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:54.627572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:54.628333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.628948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.629464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.630592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:54.632156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:54.642859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:54.643873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:54.645355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 432/886] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:54.652729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:54.672264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af317-cf30-4d9c-97fd-3589179b30d8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:54.708842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:54.714700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5106c13-abef-4aa3-b580-41a0655b9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:54.715370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5106c13-abef-4aa3-b580-41a0655b9819 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.715656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5106c13-abef-4aa3-b580-41a0655b9819 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.715932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5106c13-abef-4aa3-b580-41a0655b9819 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5106c13-abef-4aa3-b580-41a0655b9819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e5106c13-abef-4aa3-b580-41a0655b9819 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:54.769829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:54.770709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:54.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 455/887] 10.222.0.75 () {56 vars in 1120 bytes} [Mon Sep 19 14:50:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:54.772463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5106c13-abef-4aa3-b580-41a0655b9819 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:54.772555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:54.779705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f53193-59d2-4ab5-ab22-6af49b51c407 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:54.816971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:54.817631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.818113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.818547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.819330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:54.819786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:54.821469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:54.827087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 433/888] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:54.832664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:54.899181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5106c13-abef-4aa3-b580-41a0655b9819 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:54.943714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:54.944442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:54.944751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:54.945028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:54.945715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:54.946155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:54.948133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:54.953272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6a914-88e4-4fd4-8c8e-c81bef18e68f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:54.964664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 456/889] 10.222.0.75 () {56 vars in 1115 bytes} [Mon Sep 19 14:50:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:54.965581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:54.999508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.000646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.001124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.001984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.004132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:55.004887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.006470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.013768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 434/890] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:55.020497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.037826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:55.047634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:55.104545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544886f-dcb5-4c9b-948d-e52d61bc0158 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.145192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848e3d4-a194-4368-b6e5-4116ac486b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.145842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848e3d4-a194-4368-b6e5-4116ac486b23 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.146260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848e3d4-a194-4368-b6e5-4116ac486b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.146387 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848e3d4-a194-4368-b6e5-4116ac486b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.150535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431fd4-c15b-49f3-aa81-ae39f3167f8d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.158334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848e3d4-a194-4368-b6e5-4116ac486b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.159836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848e3d4-a194-4368-b6e5-4116ac486b23 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3848e3d4-a194-4368-b6e5-4116ac486b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:55.175119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:55.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:55.177763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:55.177763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:55.177763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:55.177763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 457/891] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:55.178763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75f87-ae44-459d-b5d6-36e14f119850 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.178763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75f87-ae44-459d-b5d6-36e14f119850 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.178924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75f87-ae44-459d-b5d6-36e14f119850 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.180306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 458/892] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:55.185202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd75f87-ae44-459d-b5d6-36e14f119850 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.193947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c5124-b681-4445-987e-c9378362cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.194568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5124-b681-4445-987e-c9378362cb15 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.194851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5124-b681-4445-987e-c9378362cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.195129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5124-b681-4445-987e-c9378362cb15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.195833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c5124-b681-4445-987e-c9378362cb15 None admin] RBAC: Adding query filter params (interface=public, service_id=d8b074df56ca41cbb0ae66357c8d866e, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:55.196141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c5124-b681-4445-987e-c9378362cb15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.197552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c5124-b681-4445-987e-c9378362cb15 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.202786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 435/893] 10.222.0.75 () {56 vars in 1251 bytes} [Mon Sep 19 14:50:55 2022] GET /identity/v3/endpoints?service_id=d8b074df56ca41cbb0ae66357c8d866e&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:55.204139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256227a-1c06-42b6-a56c-a5165dedd528 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.204425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256227a-1c06-42b6-a56c-a5165dedd528 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.204734 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256227a-1c06-42b6-a56c-a5165dedd528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.222528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a256227a-1c06-42b6-a56c-a5165dedd528 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:55.223724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a256227a-1c06-42b6-a56c-a5165dedd528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:55.291126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 436/894] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:55.292309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ef19-ecf3-440e-ba81-6d6b8df443d4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.292622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ef19-ecf3-440e-ba81-6d6b8df443d4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.292914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ef19-ecf3-440e-ba81-6d6b8df443d4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.294231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 437/895] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:55.294919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17ef19-ecf3-440e-ba81-6d6b8df443d4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.306684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd75f87-ae44-459d-b5d6-36e14f119850 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.309324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:55.323881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:55.359962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01e941-be78-4285-8588-f9bdf8c4ff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.361051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01e941-be78-4285-8588-f9bdf8c4ff03 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.361334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01e941-be78-4285-8588-f9bdf8c4ff03 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.361606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01e941-be78-4285-8588-f9bdf8c4ff03 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.362255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01e941-be78-4285-8588-f9bdf8c4ff03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:55.362557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01e941-be78-4285-8588-f9bdf8c4ff03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.364771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01e941-be78-4285-8588-f9bdf8c4ff03 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.381457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 459/896] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:55.381457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2a4a2-899a-4576-91de-0a19578107d8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.381457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2a4a2-899a-4576-91de-0a19578107d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.381457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2a4a2-899a-4576-91de-0a19578107d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.404460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-10c2a4a2-899a-4576-91de-0a19578107d8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:55.405875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-10c2a4a2-899a-4576-91de-0a19578107d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:55.438894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17ef19-ecf3-440e-ba81-6d6b8df443d4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.479373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907787bc-72a5-4f2c-b083-f944cc00f88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.480016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907787bc-72a5-4f2c-b083-f944cc00f88b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.480279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907787bc-72a5-4f2c-b083-f944cc00f88b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.492700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907787bc-72a5-4f2c-b083-f944cc00f88b None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.492837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 460/897] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:55.492930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907787bc-72a5-4f2c-b083-f944cc00f88b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.493002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2a4a2-899a-4576-91de-0a19578107d8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.493071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907787bc-72a5-4f2c-b083-f944cc00f88b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.500970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 438/898] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:50:55 2022] GET /identity/v3/services => generated 1268 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:50:55.584620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907787bc-72a5-4f2c-b083-f944cc00f88b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.611034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:55.623378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2a4a2-899a-4576-91de-0a19578107d8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.672005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.672712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.672996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.673272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.684462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.685989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.691234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:50:55.705563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:55.706711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:55.708021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 461/899] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:50:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:55.713003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.726125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907787bc-72a5-4f2c-b083-f944cc00f88b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.777539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.778561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.779146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.779620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.780400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.783072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:55.795861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:55.818981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:55.820123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 439/900] 10.222.0.75 () {56 vars in 1132 bytes} [Mon Sep 19 14:50:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:55.821238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.842768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e969f-8993-4d22-9048-aa372a7e6d23 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.885579 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.886232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.886517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.886789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.887523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:55.887850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.889843 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:55.914180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51559238-81d0-4bdd-a011-4be5aa561c8f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:55.915677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 462/901] 10.222.0.75 () {56 vars in 1149 bytes} [Mon Sep 19 14:50:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:55.916674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:55.929671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:55.966377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf45a14-81c9-4247-93d1-541edbd09177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:55.967334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf45a14-81c9-4247-93d1-541edbd09177 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:55.967805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf45a14-81c9-4247-93d1-541edbd09177 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:55.968129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf45a14-81c9-4247-93d1-541edbd09177 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:55.968819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf45a14-81c9-4247-93d1-541edbd09177 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:55.970347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf45a14-81c9-4247-93d1-541edbd09177 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:56.023520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae6c1-88a9-461a-bc6f-4e2d62ce9ddf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:56.048711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 440/902] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:50:55 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:56.048711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf45a14-81c9-4247-93d1-541edbd09177 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:56.052320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:56.079640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:56.080361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:56.080882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:56.081171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:56.082993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:56.083389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:56.085686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:56.093849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 463/903] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:50:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:56.100528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:56.212964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:56.225871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf45a14-81c9-4247-93d1-541edbd09177 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:56.257372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678bdb3-5097-4b84-92e8-9e457d1e6456 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:56.270362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83853bbd-f1b5-46c7-a03d-d3428c50d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:56.271416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853bbd-f1b5-46c7-a03d-d3428c50d64d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:56.271758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853bbd-f1b5-46c7-a03d-d3428c50d64d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:56.272098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853bbd-f1b5-46c7-a03d-d3428c50d64d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:56.312400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:56.313443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:56.313937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:56.314429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:56.316707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:56.317288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:56.319596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:56.332785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 464/904] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:50:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:56.336403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:56.362356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83853bbd-f1b5-46c7-a03d-d3428c50d64d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:56.364246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83853bbd-f1b5-46c7-a03d-d3428c50d64d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:56.366730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:56.499021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad880-1433-43f6-bf1a-b38a3450ae2b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:56.504455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 441/905] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:50:56 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:50:56.510297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83853bbd-f1b5-46c7-a03d-d3428c50d64d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:56.541860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:56.543657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:56.543979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:56.544267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:56.545180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] RBAC: Adding query filter params (interface=public, service_id=21deeb2516ab4b299a4bca6b160d92ed, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:56.545536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:56.547182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:56.549219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:56.559625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 465/906] 10.222.0.75 () {56 vars in 1251 bytes} [Mon Sep 19 14:50:56 2022] GET /identity/v3/endpoints?service_id=21deeb2516ab4b299a4bca6b160d92ed&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:56.565627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:56.647991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83853bbd-f1b5-46c7-a03d-d3428c50d64d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:56.652426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:56.694860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:56.695879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:56.696400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:56.696950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:56.709209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e2436-928c-4bca-8222-cdb1eac56a1c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:56.710624 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:56.713642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:50:56.733019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:56.734047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:50:56.735031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:50:56.735031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:50:56.735031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:56.738129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 442/907] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:56.743956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:56.757116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8debb3-8c4b-4802-9008-dddbb7b9e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:56.757737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8debb3-8c4b-4802-9008-dddbb7b9e42f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:56.758020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8debb3-8c4b-4802-9008-dddbb7b9e42f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:56.758297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8debb3-8c4b-4802-9008-dddbb7b9e42f None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:56.758969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8debb3-8c4b-4802-9008-dddbb7b9e42f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:56.760419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8debb3-8c4b-4802-9008-dddbb7b9e42f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:56.773235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 466/908] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:50:56 2022] GET /identity/v3/services => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:50:56.896284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e56aef-1318-4a84-90a7-2ce50727ced3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:56.939491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:56.940036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:56.940320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:56.940635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:56.941448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:56.941839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:56.943239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:56.957712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 443/909] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:56.963744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8debb3-8c4b-4802-9008-dddbb7b9e42f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:57.032702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:57.076853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8debb3-8c4b-4802-9008-dddbb7b9e42f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:57.114077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:57.114718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:57.115005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:57.115283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:57.122543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:57.124011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:50:57.136596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:57.137542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:57.138670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 467/910] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:57.146090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:57.163744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:57.255071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bf43-4f4d-462d-9104-c0af6b5cca97 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:57.293265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2e8e6-dfc1-4e94-91b7-4550141ec7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:57.294260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e8e6-dfc1-4e94-91b7-4550141ec7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:57.294756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e8e6-dfc1-4e94-91b7-4550141ec7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:57.295231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e8e6-dfc1-4e94-91b7-4550141ec7b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:57.296123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2e8e6-dfc1-4e94-91b7-4550141ec7b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:57.296689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2e8e6-dfc1-4e94-91b7-4550141ec7b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:57.298416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2e8e6-dfc1-4e94-91b7-4550141ec7b8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:57.316555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 444/911] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:57.318577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:57.429225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e160e6-ac13-4a8a-9553-7a40da400607 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:57.454559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:57.467382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a3272-1b3d-40a2-9354-adec67e5fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:57.468239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a3272-1b3d-40a2-9354-adec67e5fcfa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:57.468753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a3272-1b3d-40a2-9354-adec67e5fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:57.469224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a3272-1b3d-40a2-9354-adec67e5fcfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:57.470134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a3272-1b3d-40a2-9354-adec67e5fcfa None admin] RBAC: Adding query filter params (role.id=94543b29ba2f4cd58b29f88e0dd1052a, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=0c8b9fb92f244a11a8dc082a9bee85f6) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:57.470645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a3272-1b3d-40a2-9354-adec67e5fcfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:57.472433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a3272-1b3d-40a2-9354-adec67e5fcfa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:57.482510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 468/912] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:50:57 2022] GET /identity/v3/role_assignments?user.id=0c8b9fb92f244a11a8dc082a9bee85f6&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=94543b29ba2f4cd58b29f88e0dd1052a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:57.818654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188530c-6af3-41a3-bb67-0ad9678656ef None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:57.819008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188530c-6af3-41a3-bb67-0ad9678656ef None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:57.819214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188530c-6af3-41a3-bb67-0ad9678656ef None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:57.820862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 445/913] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:57.826329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4097-6ff3-4a47-88a7-101b41c507c3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:57.826691 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4097-6ff3-4a47-88a7-101b41c507c3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:57.826978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4097-6ff3-4a47-88a7-101b41c507c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:57.846003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0afd4097-6ff3-4a47-88a7-101b41c507c3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:57.847992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0afd4097-6ff3-4a47-88a7-101b41c507c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:57.924601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 469/914] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:58.199375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188530c-6af3-41a3-bb67-0ad9678656ef None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:58.285233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:58.317441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188530c-6af3-41a3-bb67-0ad9678656ef None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:58.355849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315abf-b383-4fd6-9deb-1aa56f067f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:58.356510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315abf-b383-4fd6-9deb-1aa56f067f82 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:58.356792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315abf-b383-4fd6-9deb-1aa56f067f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:58.357069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315abf-b383-4fd6-9deb-1aa56f067f82 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:58.357653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e315abf-b383-4fd6-9deb-1aa56f067f82 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:58.359011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e315abf-b383-4fd6-9deb-1aa56f067f82 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3e315abf-b383-4fd6-9deb-1aa56f067f82 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:58.369295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:58.370333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:50:58.371168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:58.374371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 446/915] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:58.376922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd4097-6ff3-4a47-88a7-101b41c507c3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:58.452424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891576e-bc10-490e-9410-e70950337343 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:58.452642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891576e-bc10-490e-9410-e70950337343 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:58.452927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891576e-bc10-490e-9410-e70950337343 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:58.454409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 447/916] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:50:58.461440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856d8c-c573-4647-aebd-4d0c7cf3d183 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:58.462294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856d8c-c573-4647-aebd-4d0c7cf3d183 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:58.462825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856d8c-c573-4647-aebd-4d0c7cf3d183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:58.486271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4c856d8c-c573-4647-aebd-4d0c7cf3d183 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:58.488691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4c856d8c-c573-4647-aebd-4d0c7cf3d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:58.506854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd4097-6ff3-4a47-88a7-101b41c507c3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:58.525161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:58.544052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:58.544702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:58.544986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:58.545264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:58.546062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:58.546374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:58.547839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:58.553980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 470/917] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:58.559911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:58.576373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 448/918] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:50:58.666865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2aaee7-8b96-43ed-8068-09779c465792 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:58.702934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:58.703469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:58.703755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:58.704031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:58.704765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:58.705073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:58.707200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:58.716590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 471/919] 10.222.0.75 () {56 vars in 1114 bytes} [Mon Sep 19 14:50:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:58.718800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c856d8c-c573-4647-aebd-4d0c7cf3d183 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:58.808006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:58.845620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c856d8c-c573-4647-aebd-4d0c7cf3d183 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:58.880954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:58.882341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6e007-a6a5-4292-acae-b44f9109192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:58.882960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e007-a6a5-4292-acae-b44f9109192d None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:58.883243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e007-a6a5-4292-acae-b44f9109192d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:58.883520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e007-a6a5-4292-acae-b44f9109192d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:58.884261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6e007-a6a5-4292-acae-b44f9109192d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:58.885874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6e007-a6a5-4292-acae-b44f9109192d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:58.932572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:58.981933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 449/920] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:50:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:50:58.994776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a19a8-94e3-4ddd-9e4e-def1d5d4171f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:59.046063 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a73c8-1693-49ea-8fd8-197be8dd1dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:59.047035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a73c8-1693-49ea-8fd8-197be8dd1dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.047482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a73c8-1693-49ea-8fd8-197be8dd1dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.048022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a73c8-1693-49ea-8fd8-197be8dd1dd9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.048884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a73c8-1693-49ea-8fd8-197be8dd1dd9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:59.050609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a73c8-1693-49ea-8fd8-197be8dd1dd9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c08a73c8-1693-49ea-8fd8-197be8dd1dd9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:59.061671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:59.062996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:50:59.064085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:50:59.067345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 472/921] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:50:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:50:59.073804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6e007-a6a5-4292-acae-b44f9109192d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:59.169264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c1dac-2bc0-4072-bf13-6ff43f56063e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.169548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c1dac-2bc0-4072-bf13-6ff43f56063e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.169823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c1dac-2bc0-4072-bf13-6ff43f56063e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.171446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 473/922] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:59.177747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8959a0d-180c-48ea-9f83-354575dde5d0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.178133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8959a0d-180c-48ea-9f83-354575dde5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.179158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8959a0d-180c-48ea-9f83-354575dde5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.202282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c8959a0d-180c-48ea-9f83-354575dde5d0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:59.203499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c8959a0d-180c-48ea-9f83-354575dde5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:59.210291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6e007-a6a5-4292-acae-b44f9109192d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:59.239751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:59.253669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:59.256438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.256438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.256438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.256438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:59.256438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:59.258442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:59.262484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 450/923] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:50:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:59.269568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:59.292977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 474/924] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:59.376750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483567-6ac0-4f08-be8d-bfded31acd92 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:59.413125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:59.413742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.414025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.414301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.414938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:59.415243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:59.416636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:59.422328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 451/925] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:50:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:50:59.428204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8959a0d-180c-48ea-9f83-354575dde5d0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:59.467273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:59.542390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8959a0d-180c-48ea-9f83-354575dde5d0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:59.577344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:59.582684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:59.583486 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.583781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.584092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.584904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] RBAC: Adding query filter params (interface=public, service_id=db0c285da6144a59bb235bc94dbee233, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:59.585215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:59.586602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:59.593525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 475/926] 10.222.0.75 () {56 vars in 1251 bytes} [Mon Sep 19 14:50:59 2022] GET /identity/v3/endpoints?service_id=db0c285da6144a59bb235bc94dbee233&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:50:59.599718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:59.656846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:59.708414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad8a51-a8df-4fb2-a25d-fa356e2b52f6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:59.732996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:59.737367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18688-da0d-4e9b-ba0c-d8dca80894b2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:59.749257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dd138-4d33-437c-9e79-956bf6120d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:59.750013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd138-4d33-437c-9e79-956bf6120d5d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.750298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd138-4d33-437c-9e79-956bf6120d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.753804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd138-4d33-437c-9e79-956bf6120d5d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.753804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd138-4d33-437c-9e79-956bf6120d5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:59.753804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd138-4d33-437c-9e79-956bf6120d5d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f32dd138-4d33-437c-9e79-956bf6120d5d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:50:59.762579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:50:59.763661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:50:59.764906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:50:59.768738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 452/927] 10.222.0.75 () {56 vars in 1132 bytes} [Mon Sep 19 14:50:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:50:59.770967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b681-7dcd-4bce-aacb-e95a913d5f1c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.771254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b681-7dcd-4bce-aacb-e95a913d5f1c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.771523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b681-7dcd-4bce-aacb-e95a913d5f1c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.775237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 453/928] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:59.775237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10b681-7dcd-4bce-aacb-e95a913d5f1c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:59.788231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3ca9-9f32-43db-9474-8312ae29c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:59.788901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3ca9-9f32-43db-9474-8312ae29c58f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.789184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3ca9-9f32-43db-9474-8312ae29c58f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.789460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3ca9-9f32-43db-9474-8312ae29c58f None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.790098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3ca9-9f32-43db-9474-8312ae29c58f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:59.791475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3ca9-9f32-43db-9474-8312ae29c58f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:59.797989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 476/929] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:50:59 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:50:59.799266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef004dc-427a-4137-a000-2abaf1875ff7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.799912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef004dc-427a-4137-a000-2abaf1875ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.799912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef004dc-427a-4137-a000-2abaf1875ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.819743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5ef004dc-427a-4137-a000-2abaf1875ff7 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:59.821038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5ef004dc-427a-4137-a000-2abaf1875ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:59.924628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10b681-7dcd-4bce-aacb-e95a913d5f1c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:59.925968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 477/930] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:50:59.948154 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:59.969524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:59.970270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:59.970554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:59.970832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:59.971483 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:50:59.971788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:59.973841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:59.979954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 454/931] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:50:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:00.028132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef004dc-427a-4137-a000-2abaf1875ff7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:00.112534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:00.123179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef004dc-427a-4137-a000-2abaf1875ff7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:00.159200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:00.161025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:00.161531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:00.161954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:00.162761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:00.163221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:00.164758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:00.170467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 478/932] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:50:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:00.179273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:00.216972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:00.287207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069827-0fa0-4b30-9b38-5bf8ca651c80 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:00.327134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe73d1-e4f9-466c-9950-e97f2b3a9371 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:00.333555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907792-d5b3-40e3-a361-394227ef20fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:00.334196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907792-d5b3-40e3-a361-394227ef20fc None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:00.334481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907792-d5b3-40e3-a361-394227ef20fc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:00.334759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907792-d5b3-40e3-a361-394227ef20fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:00.335454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907792-d5b3-40e3-a361-394227ef20fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:00.336862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907792-d5b3-40e3-a361-394227ef20fc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:00.369917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbae73-ce5c-45eb-adae-c0b7d1a91cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:00.370476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbae73-ce5c-45eb-adae-c0b7d1a91cdb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:00.370753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbae73-ce5c-45eb-adae-c0b7d1a91cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:00.371023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbae73-ce5c-45eb-adae-c0b7d1a91cdb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:00.383308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbae73-ce5c-45eb-adae-c0b7d1a91cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-bcdbae73-ce5c-45eb-adae-c0b7d1a91cdb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:00.388288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:00.389272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:00.391615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 479/933] 10.222.0.75 () {56 vars in 1120 bytes} [Mon Sep 19 14:51:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:00.398335 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbae73-ce5c-45eb-adae-c0b7d1a91cdb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:00.417904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:00.464642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 455/934] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:51:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:00.515970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbae73-ce5c-45eb-adae-c0b7d1a91cdb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:00.565439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:00.566583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:00.567070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:00.567543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:00.569028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:00.569542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:00.571205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:00.581763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 480/935] 10.222.0.75 () {56 vars in 1115 bytes} [Mon Sep 19 14:51:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:00.588230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907792-d5b3-40e3-a361-394227ef20fc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:00.630892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:00.706165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907792-d5b3-40e3-a361-394227ef20fc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:00.742628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:00.743606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:00.744079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:00.744576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:00.757008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:00.758849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:00.774644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:00.775638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:00.776546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:00.776546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:00.776546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:00.779667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 456/936] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:00.785199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:00.869934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:00.894578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f658ce-d2ce-4842-a313-4855bf601432 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:00.932561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:00.933317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:00.933692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:00.934062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:00.934804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:00.935204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:00.936704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:00.950414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 481/937] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:00.958913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:01.067111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:01.079518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc66cb-b433-434d-a0a2-9bdde9ee5144 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:01.118315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:01.119018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:01.119296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:01.119567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.127377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:01.129455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:51:01.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:01.145361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:01.148684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 457/938] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:51:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:01.154511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:01.277256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746786-5372-4974-9c05-f5c7cd48e38c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:01.325597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c511bf-2b80-46c7-92b3-6aa0755f1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:01.326228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c511bf-2b80-46c7-92b3-6aa0755f1f8d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:01.326510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c511bf-2b80-46c7-92b3-6aa0755f1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:01.326783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c511bf-2b80-46c7-92b3-6aa0755f1f8d None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.327534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c511bf-2b80-46c7-92b3-6aa0755f1f8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:01.327842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c511bf-2b80-46c7-92b3-6aa0755f1f8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:01.329390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c511bf-2b80-46c7-92b3-6aa0755f1f8d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:01.332176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:01.354425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 482/939] 10.222.0.75 () {56 vars in 1149 bytes} [Mon Sep 19 14:51:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:01.360355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:01.473118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00c25e-ccdb-418e-9132-0ed65c70a447 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:01.484503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939f5f-3339-4201-890e-9447ba9afbd7 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:01.485120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939f5f-3339-4201-890e-9447ba9afbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:01.485593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1939f5f-3339-4201-890e-9447ba9afbd7 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.487395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 483/940] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:51:01.493744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69668-ae41-47a2-b0cc-48e7a1214968 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:01.494296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69668-ae41-47a2-b0cc-48e7a1214968 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:01.494769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69668-ae41-47a2-b0cc-48e7a1214968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.512952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:01.513599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:01.513875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:01.514208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.520763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-52b69668-ae41-47a2-b0cc-48e7a1214968 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:01.522887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-52b69668-ae41-47a2-b0cc-48e7a1214968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:01.526978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:01.528521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:01.541683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:01.549653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:01.556456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:01.558279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:01.558279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:01.558279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:01.558279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 458/941] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:01.559111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:01.652515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 484/942] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:01.723331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd70ba-0794-4469-992a-92547c486631 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:01.761000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:01.762001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:01.762480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:01.762961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.763848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:01.764346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:01.765926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:01.781180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 459/943] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:01.786251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b69668-ae41-47a2-b0cc-48e7a1214968 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:01.908664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b69668-ae41-47a2-b0cc-48e7a1214968 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:01.934517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:01.954138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:01.955159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:01.955617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:01.956072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:01.966501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:01.968270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:51:01.981472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:01.982434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:01.984093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 485/944] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:01.988970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:02.055291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:02.061017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:02.121344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9b638-e630-4c68-ad49-e153f22f16cc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:02.174895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8082288-80ae-4d5c-94e6-83cdc3f1e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:02.175985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8082288-80ae-4d5c-94e6-83cdc3f1e836 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:02.176462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8082288-80ae-4d5c-94e6-83cdc3f1e836 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:02.176963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8082288-80ae-4d5c-94e6-83cdc3f1e836 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:02.179168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8082288-80ae-4d5c-94e6-83cdc3f1e836 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:02.179722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8082288-80ae-4d5c-94e6-83cdc3f1e836 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:02.183953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8082288-80ae-4d5c-94e6-83cdc3f1e836 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:02.204942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 460/945] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:02.214568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c5b2-deab-4fb9-863d-bee48091bc75 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:02.214897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c5b2-deab-4fb9-863d-bee48091bc75 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:02.215125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c5b2-deab-4fb9-863d-bee48091bc75 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:02.216650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 461/946] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:51:02.217972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9c5b2-deab-4fb9-863d-bee48091bc75 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:02.227265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb66e-5452-4b41-8bda-49c03271d9e4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:02.285559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:02.286586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:02.287108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:02.287603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:02.288355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:02.289835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:02.292852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING keystone.server.flask.common [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 14:51:02.349913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.sql.core [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:51:02.349913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 14:51:02.349913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [parameters: {'id': '7dac235cfdd24894aaa1d80bfa37649e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 14:51:02.349913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81643) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-35dedec0-7d37-47dc-af8c-7bba829792fa None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7dac235cfdd24894aaa1d80bfa37649e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7dac235cfdd24894aaa1d80bfa37649e. Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:51:02.357535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 14:51:02.358679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application yield resource Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise self.value Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application session.commit() Sep 19 14:51:02.365992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:51:02.367031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:51:02.367929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:51:02.368734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [parameters: {'id': '7dac235cfdd24894aaa1d80bfa37649e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:02.369789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:02.370756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7dac235cfdd24894aaa1d80bfa37649e. Sep 19 14:51:02.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.373189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9c5b2-deab-4fb9-863d-bee48091bc75 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:02.373368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 486/947] 10.222.0.75 () {60 vars in 1140 bytes} [Mon Sep 19 14:51:02 2022] POST /identity/v3/projects => generated 262 bytes in 299 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:02.373368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fa43-901c-4047-b1ff-bea3d7bdade4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:02.373368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fa43-901c-4047-b1ff-bea3d7bdade4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:02.373368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2fa43-901c-4047-b1ff-bea3d7bdade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:02.383801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6bc2fa43-901c-4047-b1ff-bea3d7bdade4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:02.385392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6bc2fa43-901c-4047-b1ff-bea3d7bdade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:02.401006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:02.418958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72e0d9-81ca-4151-943d-f4facee3d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:02.419951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72e0d9-81ca-4151-943d-f4facee3d33a None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:02.420232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72e0d9-81ca-4151-943d-f4facee3d33a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:02.420525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72e0d9-81ca-4151-943d-f4facee3d33a None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/0c8b9fb92f244a11a8dc082a9bee85f6/roles/94543b29ba2f4cd58b29f88e0dd1052a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:02.422853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72e0d9-81ca-4151-943d-f4facee3d33a None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=0c8b9fb92f244a11a8dc082a9bee85f6, role_id=94543b29ba2f4cd58b29f88e0dd1052a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:02.424289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72e0d9-81ca-4151-943d-f4facee3d33a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:02.426717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:02.469963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 487/948] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:02.471058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2fa43-901c-4047-b1ff-bea3d7bdade4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:02.568814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 462/949] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:51:02 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/0c8b9fb92f244a11a8dc082a9bee85f6/roles/94543b29ba2f4cd58b29f88e0dd1052a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:51:02.622396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2fa43-901c-4047-b1ff-bea3d7bdade4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:02.667941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:02.669613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:02.670341 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:02.671153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:02.681745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:02.683932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:51:02.699090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:02.700280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:02.701449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:51:02.701449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:51:02.701449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:51:02.701449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:51:02.701449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:51:02.701449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:51:02.701449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:02.701449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.704128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 488/950] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:02.711131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72e0d9-81ca-4151-943d-f4facee3d33a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:02.761031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:02.799428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:02.848277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72e0d9-81ca-4151-943d-f4facee3d33a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:02.888404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:02.889508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:02.890083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:02.890623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:02.891606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:02.892147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:02.894521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:02.914667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9bda-c678-4577-8b6c-495e06cb7fc0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:02.922526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 463/951] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:51:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:02.974027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277632a7-d029-407d-bdd7-63cecc7e4657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:02.974678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277632a7-d029-407d-bdd7-63cecc7e4657 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:02.974955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277632a7-d029-407d-bdd7-63cecc7e4657 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:02.975229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277632a7-d029-407d-bdd7-63cecc7e4657 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:02.975827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277632a7-d029-407d-bdd7-63cecc7e4657 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:02.977254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277632a7-d029-407d-bdd7-63cecc7e4657 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-277632a7-d029-407d-bdd7-63cecc7e4657 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:02.995311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:02.996602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:02.997510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 489/952] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:51:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:03.003424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:03.035400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b311e9-f168-4bee-9d0a-b28c049a762a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.035667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b311e9-f168-4bee-9d0a-b28c049a762a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.036012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b311e9-f168-4bee-9d0a-b28c049a762a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:03.043811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 490/953] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:51:03.049284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565992-918c-46bc-aff3-5d0c5e534676 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.049716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565992-918c-46bc-aff3-5d0c5e534676 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.050129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565992-918c-46bc-aff3-5d0c5e534676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:03.065501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:03.070385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-45565992-918c-46bc-aff3-5d0c5e534676 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:03.071770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-45565992-918c-46bc-aff3-5d0c5e534676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:03.148942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362759b-60f8-45da-8b0d-000b8acab650 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:03.167180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 491/954] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:03.192326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:03.192983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.193258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.193605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:03.194254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:03.194618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:03.196046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:03.201962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 464/955] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:51:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:03.209458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565992-918c-46bc-aff3-5d0c5e534676 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:03.247363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:03.334963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565992-918c-46bc-aff3-5d0c5e534676 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:03.375377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:03.376425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.377005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.377464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:03.378342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:03.378885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:03.380456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:03.386553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 492/956] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:51:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:03.396528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:03.533510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffe902-79c1-4122-87ea-6d6a846fa6d6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:03.537526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:03.544780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:03.581699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e737c-3e68-4ace-a119-5f2f5911486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:03.582383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e737c-3e68-4ace-a119-5f2f5911486d None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.582655 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e737c-3e68-4ace-a119-5f2f5911486d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.582856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e737c-3e68-4ace-a119-5f2f5911486d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:03.583532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e737c-3e68-4ace-a119-5f2f5911486d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:03.584952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e737c-3e68-4ace-a119-5f2f5911486d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:03.655825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:03.678401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60bb01-74e4-4558-8acf-be335e61aa08 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:03.682325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 465/957] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:51:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:03.736722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:03.737382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.738653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.738956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:03.739696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:03.741196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:03.751647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:03.752754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:03.754653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 493/958] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:03.761123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e737c-3e68-4ace-a119-5f2f5911486d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:03.904814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e737c-3e68-4ace-a119-5f2f5911486d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:03.947212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05580a-b11b-4dee-84bd-328f87c81be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:03.948060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05580a-b11b-4dee-84bd-328f87c81be8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:03.948537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05580a-b11b-4dee-84bd-328f87c81be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:03.948823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05580a-b11b-4dee-84bd-328f87c81be8 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:03.949472 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05580a-b11b-4dee-84bd-328f87c81be8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:03.949775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05580a-b11b-4dee-84bd-328f87c81be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:03.951162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05580a-b11b-4dee-84bd-328f87c81be8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:03.957401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 466/959] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:51:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:03.963474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:04.083092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddd516-a9eb-4cee-a661-ae53d8ec0170 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:04.119712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13448048-a313-4000-b043-07b5614797f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:04.120609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448048-a313-4000-b043-07b5614797f7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:04.121124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448048-a313-4000-b043-07b5614797f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:04.121561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13448048-a313-4000-b043-07b5614797f7 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:04.122398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13448048-a313-4000-b043-07b5614797f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:04.122706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13448048-a313-4000-b043-07b5614797f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:04.124081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13448048-a313-4000-b043-07b5614797f7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:04.130467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 494/960] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:51:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:05.103650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b878238-a292-456d-9083-ad3ec876524c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:05.104175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b878238-a292-456d-9083-ad3ec876524c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:05.104175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b878238-a292-456d-9083-ad3ec876524c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:05.105946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 467/961] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:05.112404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57506999-0231-46ce-91ef-6677953b22cc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:05.112404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57506999-0231-46ce-91ef-6677953b22cc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:05.112404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57506999-0231-46ce-91ef-6677953b22cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:05.132281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-57506999-0231-46ce-91ef-6677953b22cc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:05.133805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-57506999-0231-46ce-91ef-6677953b22cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:05.137171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:05.216426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 495/962] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:51:05.499941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb31e7-b373-4a5f-989f-e05926f39d0a None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:05.500826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb31e7-b373-4a5f-989f-e05926f39d0a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:05.501628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb31e7-b373-4a5f-989f-e05926f39d0a None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:05.505473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 468/963] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:05.510635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9160-5d64-4975-8f09-833f1cd04b8a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:05.510924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9160-5d64-4975-8f09-833f1cd04b8a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:05.511206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9160-5d64-4975-8f09-833f1cd04b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:05.530880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a8ec9160-5d64-4975-8f09-833f1cd04b8a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:05.532155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a8ec9160-5d64-4975-8f09-833f1cd04b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:05.546556 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb31e7-b373-4a5f-989f-e05926f39d0a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:05.576140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:05.609568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 496/964] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:05.665942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb31e7-b373-4a5f-989f-e05926f39d0a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:05.705651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e9c7a-04fa-434d-bcff-fd361e17f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:05.706710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9c7a-04fa-434d-bcff-fd361e17f2db None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:05.707155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9c7a-04fa-434d-bcff-fd361e17f2db None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:05.707569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9c7a-04fa-434d-bcff-fd361e17f2db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:05.719344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e9c7a-04fa-434d-bcff-fd361e17f2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-510e9c7a-04fa-434d-bcff-fd361e17f2db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:05.725117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:05.726246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:05.727357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:05.729645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 469/965] 10.222.0.75 () {56 vars in 1120 bytes} [Mon Sep 19 14:51:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:05.735680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9160-5d64-4975-8f09-833f1cd04b8a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:05.860879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:05.917840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e9c7a-04fa-434d-bcff-fd361e17f2db None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:05.929221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9160-5d64-4975-8f09-833f1cd04b8a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:05.979650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:05.980658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:05.981115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:05.981576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:05.982902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:05.983405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:05.985811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:06.001786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 497/966] 10.222.0.75 () {56 vars in 1115 bytes} [Mon Sep 19 14:51:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:06.008274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:06.062219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:06.085047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e9c7a-04fa-434d-bcff-fd361e17f2db None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:06.126568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb3738-1b74-4d93-a45a-c94b393b4215 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:06.132289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:06.134338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.135299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.136051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.137701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:06.140983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:06.146386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING keystone.server.flask.common [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 14:51:06.163109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:06.168078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950d573-8465-43a9-8a63-1dbfd81278b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:06.168761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950d573-8465-43a9-8a63-1dbfd81278b6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.169042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950d573-8465-43a9-8a63-1dbfd81278b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.169314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950d573-8465-43a9-8a63-1dbfd81278b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.181769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950d573-8465-43a9-8a63-1dbfd81278b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:06.183253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950d573-8465-43a9-8a63-1dbfd81278b6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e950d573-8465-43a9-8a63-1dbfd81278b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:06.199083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:06.200300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:06.201283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:06.201283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:06.201283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:06.201283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 498/967] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:06.201802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987ffe-45b8-49b7-b2a3-9a36a14b589a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.201897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987ffe-45b8-49b7-b2a3-9a36a14b589a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.202256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987ffe-45b8-49b7-b2a3-9a36a14b589a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.203621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 499/968] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:06.206448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f987ffe-45b8-49b7-b2a3-9a36a14b589a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:06.212198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.sql.core [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:51:06.212198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 14:51:06.212198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [parameters: {'user_id': 'f0c00e4cd87c4cf2810ac00c5ebfc8e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 14:51:06.212198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81644) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1ded07b6-8806-4976-9bee-fd0b212ea88f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application result.read() Sep 19 14:51:06.229481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:51:06.230642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application yield resource Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise self.value Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application session.commit() Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:51:06.231854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:51:06.233185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:51:06.234908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application result.read() Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:51:06.237187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f0c00e4cd87c4cf2810ac00c5ebfc8e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:06.240239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 14:51:06.241794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 470/969] 10.222.0.75 () {60 vars in 1131 bytes} [Mon Sep 19 14:51:05 2022] POST /identity/v3/users => generated 160 bytes in 314 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001daec-9631-41e9-92cd-ee9234f0e7c3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001daec-9631-41e9-92cd-ee9234f0e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.243779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001daec-9631-41e9-92cd-ee9234f0e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.257477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a001daec-9631-41e9-92cd-ee9234f0e7c3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:06.257477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a001daec-9631-41e9-92cd-ee9234f0e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:06.339181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 471/970] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:06.339809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001daec-9631-41e9-92cd-ee9234f0e7c3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:06.366723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f987ffe-45b8-49b7-b2a3-9a36a14b589a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:06.407632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:06.408156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.408437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.408738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.410257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:06.410569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:06.412064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:06.430546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 500/971] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:06.433052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:06.456055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:06.489678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001daec-9631-41e9-92cd-ee9234f0e7c3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:06.497395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:06.536419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:06.537652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.538433 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.538880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.548337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:06.551441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:06.560348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdbc63-80d7-4c77-bb6e-a2ce99b26b33 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:51:06.568685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:06.569696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:06.570626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 472/972] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:51:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:06.577498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:06.612981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:06.613947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.614477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.615125 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.625235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:06.627527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:51:06.645367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:06.646427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:51:06.647436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:06.648663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 501/973] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:51:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:06.649777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:06.728917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d2df-05f0-4887-a773-91beea96c8c7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:06.786213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:06.786852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.787319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.787434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.788144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:06.788454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:06.789910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:06.793826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbdcc-5ee0-4f47-846b-2b2c0ccdb2b4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:06.796175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:06.801354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:06.828542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded8795-6aa7-4e57-89fb-e52e1573fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:06.829184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8795-6aa7-4e57-89fb-e52e1573fe84 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.829467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8795-6aa7-4e57-89fb-e52e1573fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.829739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8795-6aa7-4e57-89fb-e52e1573fe84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.840672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 473/974] 10.222.0.75 () {56 vars in 1101 bytes} [Mon Sep 19 14:51:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:06.840889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded8795-6aa7-4e57-89fb-e52e1573fe84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:06.841010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:06.841110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded8795-6aa7-4e57-89fb-e52e1573fe84 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6ded8795-6aa7-4e57-89fb-e52e1573fe84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:06.843252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:06.844359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:06.845249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 502/975] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:51:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:06.846635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee80f3-51b8-4a28-9e8f-bb1c05b81dd1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:06.846635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee80f3-51b8-4a28-9e8f-bb1c05b81dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:06.848143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee80f3-51b8-4a28-9e8f-bb1c05b81dd1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:06.851224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 503/976] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:06.855081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee80f3-51b8-4a28-9e8f-bb1c05b81dd1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:06.969121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba920c9-0103-44bc-b1f8-e362911ac82b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.022343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee80f3-51b8-4a28-9e8f-bb1c05b81dd1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.031194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396be21-b505-4491-bf8d-07a385f09189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.031971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396be21-b505-4491-bf8d-07a385f09189 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.032261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396be21-b505-4491-bf8d-07a385f09189 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.032639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396be21-b505-4491-bf8d-07a385f09189 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.033465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396be21-b505-4491-bf8d-07a385f09189 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:07.033816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396be21-b505-4491-bf8d-07a385f09189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.037220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396be21-b505-4491-bf8d-07a385f09189 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.061565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 474/977] 10.222.0.75 () {56 vars in 1149 bytes} [Mon Sep 19 14:51:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:07.065040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2012-4872-498b-b5c6-b6ae1570ecc6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.065040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2012-4872-498b-b5c6-b6ae1570ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.065040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea2012-4872-498b-b5c6-b6ae1570ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.074424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.075197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.075476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.076831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.076831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:07.077617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.080149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.084193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4dea2012-4872-498b-b5c6-b6ae1570ecc6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:07.085466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4dea2012-4872-498b-b5c6-b6ae1570ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:07.088515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 504/978] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:51:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:07.088515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:07.136575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.144387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.166159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 475/979] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:07.167090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea2012-4872-498b-b5c6-b6ae1570ecc6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:07.226686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9835dfd-f5ee-46b9-8c18-c74340680c1c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.275001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741aee8-53b3-4997-83e9-15546bafe606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.275702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741aee8-53b3-4997-83e9-15546bafe606 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.275951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741aee8-53b3-4997-83e9-15546bafe606 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.276206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741aee8-53b3-4997-83e9-15546bafe606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.277537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea2012-4872-498b-b5c6-b6ae1570ecc6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.315352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.316589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.316875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.317142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.317879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:07.318185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.319562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.341030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 476/980] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:51:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:07.347248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:07.363821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741aee8-53b3-4997-83e9-15546bafe606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.365321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741aee8-53b3-4997-83e9-15546bafe606 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.406988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.430058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.481077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 505/981] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:07 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:07.481833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741aee8-53b3-4997-83e9-15546bafe606 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:07.494800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064e758-022f-45aa-801d-539d7e86a09d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.535436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.536042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.536326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.536628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.537350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] RBAC: Adding query filter params (interface=admin, service_id=db0c285da6144a59bb235bc94dbee233, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:07.537662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.539032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.544520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 477/982] 10.222.0.75 () {56 vars in 1249 bytes} [Mon Sep 19 14:51:07 2022] GET /identity/v3/endpoints?service_id=db0c285da6144a59bb235bc94dbee233&interface=admin®ion_id=RegionOne => generated 193 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:07.545331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:07.615885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741aee8-53b3-4997-83e9-15546bafe606 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.654726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.660980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607a6ac-3646-4321-9d7c-11f6d1703bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.661577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607a6ac-3646-4321-9d7c-11f6d1703bf9 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.661851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607a6ac-3646-4321-9d7c-11f6d1703bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.662124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607a6ac-3646-4321-9d7c-11f6d1703bf9 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.662772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607a6ac-3646-4321-9d7c-11f6d1703bf9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.664143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607a6ac-3646-4321-9d7c-11f6d1703bf9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.671515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da2a13-64f5-4b8e-bc5d-662c7d261c44 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.684276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:07.721134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.722324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.722601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.722876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.739274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.744659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:07.762879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:07.764793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:07.766470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:07.766470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:07.766470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:07.766470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 478/983] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:07.766470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:07.788606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 506/984] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:51:07 2022] POST /identity/v3/services => generated 242 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:07.790108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607a6ac-3646-4321-9d7c-11f6d1703bf9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:07.902021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27df8cd-f871-47bc-97ef-d1be22e53238 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.950611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607a6ac-3646-4321-9d7c-11f6d1703bf9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:07.953658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11b98-1499-4653-8714-c7ecc7d1f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:07.954286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11b98-1499-4653-8714-c7ecc7d1f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:07.954569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11b98-1499-4653-8714-c7ecc7d1f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:07.954843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11b98-1499-4653-8714-c7ecc7d1f7c7 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:07.955462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec11b98-1499-4653-8714-c7ecc7d1f7c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:07.957908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec11b98-1499-4653-8714-c7ecc7d1f7c7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:07.968919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 479/985] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:51:07 2022] GET /identity/v3/services => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:51:08.012700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:08.013561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:08.013979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:08.014393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:08.015373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:08.015872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:08.018247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:08.039663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 507/986] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:08.046012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11b98-1499-4653-8714-c7ecc7d1f7c7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:08.076599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:08.172041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11b98-1499-4653-8714-c7ecc7d1f7c7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:08.212269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:08.212949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:08.213234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:08.213511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:08.221101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:08.223001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:51:08.234983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:08.235947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:08.237819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 480/987] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:08.243685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:08.298456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:08.356265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4a463-7f38-4f09-af8a-c65f41f68766 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:08.399450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20323243-6398-469c-95b7-214c3751d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:08.400069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20323243-6398-469c-95b7-214c3751d329 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:08.400353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20323243-6398-469c-95b7-214c3751d329 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:08.400725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20323243-6398-469c-95b7-214c3751d329 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:08.401374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20323243-6398-469c-95b7-214c3751d329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:08.401682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20323243-6398-469c-95b7-214c3751d329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:08.403105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20323243-6398-469c-95b7-214c3751d329 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:08.421210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 508/988] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:08.422463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:08.520840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:08.541552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52ab49-b0a3-4a29-b482-07f82b67ffff None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:08.578071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330f17d-a73b-4cd8-9fe9-5c83d1672516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:08.578698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330f17d-a73b-4cd8-9fe9-5c83d1672516 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:08.578981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330f17d-a73b-4cd8-9fe9-5c83d1672516 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:08.579345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330f17d-a73b-4cd8-9fe9-5c83d1672516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:08.580140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330f17d-a73b-4cd8-9fe9-5c83d1672516 None admin] RBAC: Adding query filter params (role.id=94543b29ba2f4cd58b29f88e0dd1052a, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=0c8b9fb92f244a11a8dc082a9bee85f6) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:08.580549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330f17d-a73b-4cd8-9fe9-5c83d1672516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:08.582060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330f17d-a73b-4cd8-9fe9-5c83d1672516 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:08.591871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 481/989] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:08 2022] GET /identity/v3/role_assignments?user.id=0c8b9fb92f244a11a8dc082a9bee85f6&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=94543b29ba2f4cd58b29f88e0dd1052a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:10.172374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1c1a1-6290-4f18-bd4f-defb92369128 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.173096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1c1a1-6290-4f18-bd4f-defb92369128 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.173096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1c1a1-6290-4f18-bd4f-defb92369128 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.175377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 509/990] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:10.181628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488bda-8581-47df-932f-eb69a5005953 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.182175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488bda-8581-47df-932f-eb69a5005953 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.182175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488bda-8581-47df-932f-eb69a5005953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.201688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6a488bda-8581-47df-932f-eb69a5005953 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:10.202875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6a488bda-8581-47df-932f-eb69a5005953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:10.276518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 482/991] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:10.282771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e46e-efb8-462c-8de5-e4b318dd6dc8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.283063 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e46e-efb8-462c-8de5-e4b318dd6dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.283342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e46e-efb8-462c-8de5-e4b318dd6dc8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.284972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 510/992] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:10.290237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b60b0-c317-49ef-be01-d9f7ad08aa13 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.290535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b60b0-c317-49ef-be01-d9f7ad08aa13 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.290816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b60b0-c317-49ef-be01-d9f7ad08aa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.311553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c60b60b0-c317-49ef-be01-d9f7ad08aa13 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:10.312806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c60b60b0-c317-49ef-be01-d9f7ad08aa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:10.383609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 483/993] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:10.575460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e46e-efb8-462c-8de5-e4b318dd6dc8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:10.653917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b60b0-c317-49ef-be01-d9f7ad08aa13 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:10.665579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:10.700934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e46e-efb8-462c-8de5-e4b318dd6dc8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:10.717029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:10.762279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:10.763273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.763712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.764144 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.765161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:10.767324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:10.779445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:10.780436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:10.781331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 511/994] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:10.789747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:10.830617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b60b0-c317-49ef-be01-d9f7ad08aa13 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:10.873947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:10.874601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.874881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.875162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.875754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:10.877159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:10.889930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:10.891896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:10.893356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 484/995] 10.222.0.75 () {56 vars in 1126 bytes} [Mon Sep 19 14:51:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:10.901730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:10.922720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7f70-e092-4a20-99b5-6d74b804101b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:10.958670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14e237-da7b-48c6-8711-71e59a2a85a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:10.959289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14e237-da7b-48c6-8711-71e59a2a85a0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.959566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14e237-da7b-48c6-8711-71e59a2a85a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.959838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14e237-da7b-48c6-8711-71e59a2a85a0 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.960530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14e237-da7b-48c6-8711-71e59a2a85a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:10.960883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14e237-da7b-48c6-8711-71e59a2a85a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:10.962531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14e237-da7b-48c6-8711-71e59a2a85a0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:10.967772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 512/996] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:51:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:10.969091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8e74d-df90-486e-82fa-b78c473d8784 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:10.969375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8e74d-df90-486e-82fa-b78c473d8784 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:10.969683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8e74d-df90-486e-82fa-b78c473d8784 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:10.972522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 513/997] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:10.973868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8e74d-df90-486e-82fa-b78c473d8784 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:11.008876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:11.012434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:11.041657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb4b72-de4f-4b34-a33b-77a3d08e081e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:11.077646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de346f0b-6330-4e93-b125-f95bb892493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:11.078256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346f0b-6330-4e93-b125-f95bb892493d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.078538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346f0b-6330-4e93-b125-f95bb892493d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.078814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346f0b-6330-4e93-b125-f95bb892493d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.079456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346f0b-6330-4e93-b125-f95bb892493d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:11.079935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346f0b-6330-4e93-b125-f95bb892493d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:11.081219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346f0b-6330-4e93-b125-f95bb892493d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:11.083956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8e74d-df90-486e-82fa-b78c473d8784 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:11.086422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 485/998] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:51:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:11.087876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef129129-b660-4311-b431-3b07ed2a5911 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.088158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef129129-b660-4311-b431-3b07ed2a5911 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.088432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef129129-b660-4311-b431-3b07ed2a5911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.106633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ef129129-b660-4311-b431-3b07ed2a5911 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:11.107847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ef129129-b660-4311-b431-3b07ed2a5911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:11.134211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:11.135225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.135707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.136184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.137372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:11.137807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:11.139312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:11.146657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 514/999] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:51:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:11.147944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:11.189548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 486/1000] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:11.191201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef129129-b660-4311-b431-3b07ed2a5911 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:11.267573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:11.273165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:11.276059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ccb6f-37f9-4ea9-bbff-12104040dc02 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:11.314025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef129129-b660-4311-b431-3b07ed2a5911 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:11.316923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:11.317542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.317823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.318095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.318791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:11.319091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:11.320468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:11.330683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 515/1001] 10.222.0.75 () {56 vars in 1122 bytes} [Mon Sep 19 14:51:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:11.331911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:11.356197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:11.356958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.357163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.357404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.358160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] RBAC: Adding query filter params (interface=public, service_id=a4bd87a21bed41e5b268ed0e48c873ba, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:11.358427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:11.359918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:11.366095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 487/1002] 10.222.0.75 () {56 vars in 1251 bytes} [Mon Sep 19 14:51:11 2022] GET /identity/v3/endpoints?service_id=a4bd87a21bed41e5b268ed0e48c873ba&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:11.371738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:11.466577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f3b2b-a017-4898-8342-89335f34d2eb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:11.493092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886226d-de7c-4dad-8c28-1ca638f93228 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:11.503345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce36f7-1a52-4402-bbc5-5911815b0763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:11.504047 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce36f7-1a52-4402-bbc5-5911815b0763 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.504321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce36f7-1a52-4402-bbc5-5911815b0763 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.504624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce36f7-1a52-4402-bbc5-5911815b0763 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.505294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce36f7-1a52-4402-bbc5-5911815b0763 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:11.506651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce36f7-1a52-4402-bbc5-5911815b0763 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:11.522442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:11.530144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3853bb6-2d38-4c3f-a8d3-4239cf9f01ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:11.530758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853bb6-2d38-4c3f-a8d3-4239cf9f01ad None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.531042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853bb6-2d38-4c3f-a8d3-4239cf9f01ad None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.531592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3853bb6-2d38-4c3f-a8d3-4239cf9f01ad None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.533731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3853bb6-2d38-4c3f-a8d3-4239cf9f01ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:11.533731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3853bb6-2d38-4c3f-a8d3-4239cf9f01ad None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:11.541112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 488/1003] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:51:11 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:51:11.542062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3853bb6-2d38-4c3f-a8d3-4239cf9f01ad None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:11.598736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 516/1004] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:51:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:11.694897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3853bb6-2d38-4c3f-a8d3-4239cf9f01ad None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:11.767487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:11.768143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.768448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.769077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] PATH_INFO: `/v3/services/image` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.769710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:11.771148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:11.781077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:11.782108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:11.782937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 489/1005] 10.222.0.75 () {56 vars in 1105 bytes} [Mon Sep 19 14:51:11 2022] GET /identity/v3/services/image => generated 86 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:11.789065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce36f7-1a52-4402-bbc5-5911815b0763 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:11.821950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:11.901900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce36f7-1a52-4402-bbc5-5911815b0763 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:11.937835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12385fd-1cd0-4496-abec-5257ec35847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:11.937835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12385fd-1cd0-4496-abec-5257ec35847a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:11.938202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12385fd-1cd0-4496-abec-5257ec35847a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:11.938458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12385fd-1cd0-4496-abec-5257ec35847a None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:11.939059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12385fd-1cd0-4496-abec-5257ec35847a None admin] RBAC: Adding query filter params (name=image) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:11.939414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12385fd-1cd0-4496-abec-5257ec35847a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:11.941192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12385fd-1cd0-4496-abec-5257ec35847a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:11.952370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 517/1006] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:11.958888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:12.027015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:12.082135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469336eb-da58-4b92-9019-81f95c908990 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:12.123919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff86f5-1a1a-4922-8f7f-c60b8acae856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:12.124552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff86f5-1a1a-4922-8f7f-c60b8acae856 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:12.124828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff86f5-1a1a-4922-8f7f-c60b8acae856 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:12.125103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff86f5-1a1a-4922-8f7f-c60b8acae856 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:12.125740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff86f5-1a1a-4922-8f7f-c60b8acae856 None admin] RBAC: Adding query filter params (type=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:12.126042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff86f5-1a1a-4922-8f7f-c60b8acae856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:12.127408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff86f5-1a1a-4922-8f7f-c60b8acae856 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:12.140912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 490/1007] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:13.845581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5ebfd-f1cd-4abd-95a4-8fe6569b1e8c None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:13.846099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5ebfd-f1cd-4abd-95a4-8fe6569b1e8c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:13.846178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5ebfd-f1cd-4abd-95a4-8fe6569b1e8c None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:13.847725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 518/1008] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:13.853283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9cb3-7a71-486c-b306-de0f0de57da8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:13.853793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9cb3-7a71-486c-b306-de0f0de57da8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:13.853872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9cb3-7a71-486c-b306-de0f0de57da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:13.876324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-661f9cb3-7a71-486c-b306-de0f0de57da8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:13.877581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-661f9cb3-7a71-486c-b306-de0f0de57da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:13.895560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be892-2abe-458e-bdb5-bca6fb766fba None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:13.895861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be892-2abe-458e-bdb5-bca6fb766fba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:13.896197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379be892-2abe-458e-bdb5-bca6fb766fba None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:13.899906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 519/1009] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:13.907130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78011-4ddc-4c76-ab11-7870997bc0c2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:13.907626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78011-4ddc-4c76-ab11-7870997bc0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:13.908116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa78011-4ddc-4c76-ab11-7870997bc0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:13.954146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-faa78011-4ddc-4c76-ab11-7870997bc0c2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:13.955799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-faa78011-4ddc-4c76-ab11-7870997bc0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:13.976843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 491/1010] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:14.062636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 520/1011] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:14.244980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f9cb3-7a71-486c-b306-de0f0de57da8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:14.300302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:14.334070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa78011-4ddc-4c76-ab11-7870997bc0c2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:14.355506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:14.376722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f9cb3-7a71-486c-b306-de0f0de57da8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:14.420465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af834416-ff55-4240-ad4e-1bd44b0b90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:14.421148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834416-ff55-4240-ad4e-1bd44b0b90d3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:14.421436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834416-ff55-4240-ad4e-1bd44b0b90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:14.421708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834416-ff55-4240-ad4e-1bd44b0b90d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:14.422292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af834416-ff55-4240-ad4e-1bd44b0b90d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:14.423672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af834416-ff55-4240-ad4e-1bd44b0b90d3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-af834416-ff55-4240-ad4e-1bd44b0b90d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:14.433167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:14.434250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:51:14.435165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:14.439462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 492/1012] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:14.441548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c945be-3b69-4e14-b71b-50d50380d762 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:14.441854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c945be-3b69-4e14-b71b-50d50380d762 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:14.442119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c945be-3b69-4e14-b71b-50d50380d762 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:14.443464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 493/1013] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:14.444302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c945be-3b69-4e14-b71b-50d50380d762 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:14.455467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa78011-4ddc-4c76-ab11-7870997bc0c2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:14.496707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51f4a9-b6b2-4b6a-82a8-b4fed3f00441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:14.497400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f4a9-b6b2-4b6a-82a8-b4fed3f00441 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:14.497682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f4a9-b6b2-4b6a-82a8-b4fed3f00441 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:14.497958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51f4a9-b6b2-4b6a-82a8-b4fed3f00441 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:14.499090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51f4a9-b6b2-4b6a-82a8-b4fed3f00441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:14.500589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51f4a9-b6b2-4b6a-82a8-b4fed3f00441 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:14.502159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 521/1014] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:14.503783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6518-419a-41ee-8daf-3900da67d3f5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:14.504045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6518-419a-41ee-8daf-3900da67d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:14.504270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6518-419a-41ee-8daf-3900da67d3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:14.532588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e9cf6518-419a-41ee-8daf-3900da67d3f5 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:14.535158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e9cf6518-419a-41ee-8daf-3900da67d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:14.567776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c945be-3b69-4e14-b71b-50d50380d762 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:14.580017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:14.605916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:14.606441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:14.606716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:14.606985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:14.607619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:14.607911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:14.609357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:14.615346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 494/1015] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:51:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:14.616151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:14.622664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 522/1016] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:14 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:14.623553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf6518-419a-41ee-8daf-3900da67d3f5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:14.641257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:14.749509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf6518-419a-41ee-8daf-3900da67d3f5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:14.772723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece74e-3afd-43ed-af83-622a374a4072 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:14.797785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:14.798400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:14.798680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:14.799003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:14.799778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:14.802232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:14.804955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:14.819947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872104e-6546-4048-9c89-71427ec4ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:14.820600 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872104e-6546-4048-9c89-71427ec4ce05 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:14.820989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872104e-6546-4048-9c89-71427ec4ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:14.821221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 523/1017] 10.222.0.75 () {56 vars in 1112 bytes} [Mon Sep 19 14:51:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:14.821324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872104e-6546-4048-9c89-71427ec4ce05 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:14.821965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872104e-6546-4048-9c89-71427ec4ce05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:14.822419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:14.823468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872104e-6546-4048-9c89-71427ec4ce05 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:14.910365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:14.918097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 495/1018] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:51:14 2022] POST /identity/v3/projects => generated 311 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:14.918926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872104e-6546-4048-9c89-71427ec4ce05 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:14.933501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2e53d-1ac3-435a-aa6a-b72bebb316fd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:14.951578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:14.978811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026f8e-1769-4830-b3bf-d7deb4727e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:14.979450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026f8e-1769-4830-b3bf-d7deb4727e03 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:14.979752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026f8e-1769-4830-b3bf-d7deb4727e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:14.980011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026f8e-1769-4830-b3bf-d7deb4727e03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:14.980830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21026f8e-1769-4830-b3bf-d7deb4727e03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:14.982263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21026f8e-1769-4830-b3bf-d7deb4727e03 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:15.041165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872104e-6546-4048-9c89-71427ec4ce05 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:15.071755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 524/1019] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:51:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:15.102308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369d033-a443-4ade-81f8-944bd3a299b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:15.102701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369d033-a443-4ade-81f8-944bd3a299b6 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:15.102825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369d033-a443-4ade-81f8-944bd3a299b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:15.103086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369d033-a443-4ade-81f8-944bd3a299b6 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:15.103756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369d033-a443-4ade-81f8-944bd3a299b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:15.105199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369d033-a443-4ade-81f8-944bd3a299b6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:15.204710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 496/1020] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:51:14 2022] POST /identity/v3/services => generated 242 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:17.223164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6ce5-bbc8-4e9c-9d95-085b22fb6606 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:17.223738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6ce5-bbc8-4e9c-9d95-085b22fb6606 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:17.223738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6ce5-bbc8-4e9c-9d95-085b22fb6606 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:17.225298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 525/1021] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:17.230713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933844f-b530-47e1-ad3e-5594b91cdacd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:17.231169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933844f-b530-47e1-ad3e-5594b91cdacd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:17.231274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933844f-b530-47e1-ad3e-5594b91cdacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:17.250213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5933844f-b530-47e1-ad3e-5594b91cdacd None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:17.251413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5933844f-b530-47e1-ad3e-5594b91cdacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:17.329069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 497/1022] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:17.490969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ad048-6efa-45ca-871f-7f80f19a5741 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:17.491160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ad048-6efa-45ca-871f-7f80f19a5741 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:17.491443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ad048-6efa-45ca-871f-7f80f19a5741 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:17.492966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 526/1023] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:17.498124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7822749-2438-49e9-9ddf-dca143de8e60 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:17.498417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7822749-2438-49e9-9ddf-dca143de8e60 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:17.498695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7822749-2438-49e9-9ddf-dca143de8e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:17.517146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e7822749-2438-49e9-9ddf-dca143de8e60 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:17.522606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e7822749-2438-49e9-9ddf-dca143de8e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:17.522606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:17.554685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaceec-0daf-415a-8fd1-e6d434533aca None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:17.555027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaceec-0daf-415a-8fd1-e6d434533aca None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:17.555221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaceec-0daf-415a-8fd1-e6d434533aca None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:17.556737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 527/1024] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:51:17.561718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251820-ec6b-4838-b87e-865d62aeeded None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:17.562000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251820-ec6b-4838-b87e-865d62aeeded None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:17.562273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251820-ec6b-4838-b87e-865d62aeeded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:17.580867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-17251820-ec6b-4838-b87e-865d62aeeded None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:17.582122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-17251820-ec6b-4838-b87e-865d62aeeded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:17.590428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 498/1025] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:17.621811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7822749-2438-49e9-9ddf-dca143de8e60 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:17.665667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 528/1026] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:51:17.730699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7822749-2438-49e9-9ddf-dca143de8e60 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:17.772096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cdc23-f175-4193-9777-0501f3d8bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:17.772686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cdc23-f175-4193-9777-0501f3d8bd34 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:17.772970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cdc23-f175-4193-9777-0501f3d8bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:17.776095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cdc23-f175-4193-9777-0501f3d8bd34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:17.778306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cdc23-f175-4193-9777-0501f3d8bd34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:17.778306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cdc23-f175-4193-9777-0501f3d8bd34 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:17.784837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 499/1027] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:17.786922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17251820-ec6b-4838-b87e-865d62aeeded None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:17.858619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:17.870593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cdc23-f175-4193-9777-0501f3d8bd34 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:17.879770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:17.898394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17251820-ec6b-4838-b87e-865d62aeeded None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:17.933205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb367ef-3d33-4f49-aec5-02b6e5503ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:17.933824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb367ef-3d33-4f49-aec5-02b6e5503ab2 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:17.934124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb367ef-3d33-4f49-aec5-02b6e5503ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:17.934376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb367ef-3d33-4f49-aec5-02b6e5503ab2 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:17.935046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb367ef-3d33-4f49-aec5-02b6e5503ab2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:17.936515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb367ef-3d33-4f49-aec5-02b6e5503ab2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:17.980757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cdc23-f175-4193-9777-0501f3d8bd34 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.016902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27ebd5-4d72-43de-8847-bb3fecb390bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.017542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ebd5-4d72-43de-8847-bb3fecb390bd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.017823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ebd5-4d72-43de-8847-bb3fecb390bd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.018097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ebd5-4d72-43de-8847-bb3fecb390bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.029233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27ebd5-4d72-43de-8847-bb3fecb390bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6a27ebd5-4d72-43de-8847-bb3fecb390bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:18.034559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:18.036046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 500/1028] 10.222.0.75 () {56 vars in 1120 bytes} [Mon Sep 19 14:51:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:18.037073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27ebd5-4d72-43de-8847-bb3fecb390bd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.068510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 529/1029] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:51:17 2022] POST /identity/v3/users => generated 285 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:18.068510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb367ef-3d33-4f49-aec5-02b6e5503ab2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.121749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.163648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27ebd5-4d72-43de-8847-bb3fecb390bd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.192822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb367ef-3d33-4f49-aec5-02b6e5503ab2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.203847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.204519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.204814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.205095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] PATH_INFO: `/v3/services/image` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.205730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.208466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:18.219175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:18.220509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:18.221454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 501/1030] 10.222.0.75 () {56 vars in 1105 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:18.227064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.228923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.243037 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.244195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.244195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.244195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.244981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:18.245874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.246777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:18.256932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 530/1031] 10.222.0.75 () {56 vars in 1115 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:18.263443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.347522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfd795-696e-4b74-a54c-ab44bb6b3d37 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.378096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.385113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.385730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.386063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.386283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.386920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] RBAC: Adding query filter params (name=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:18.387281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.388665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:18.390517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2cad3-48c0-41e2-91ab-023f4377c0ec None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.396522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 502/1032] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:18.400732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.434994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.435635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.435924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.436200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.447407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.448901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:18.464766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:18.465806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:18.466688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:18.466688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:18.466688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:18.466688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 531/1033] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:18.475678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.515309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.548176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c65cc-9acf-4696-85e3-0a8cfa831eba None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.587724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.588440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.588742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.589010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.589654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] RBAC: Adding query filter params (type=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:18.589953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.591314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:18.597159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 503/1034] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:18.603062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.615347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b34fa1-7328-4631-b9f0-9b58569f4bdf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.655010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.655618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.655897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.656169 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.656847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:18.657149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.658524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:18.671394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 532/1035] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:18.678362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.687306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.766589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0f04-10db-4a2b-9301-809bb9bbd616 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.795410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.803076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5dcb5-f288-42c1-98ec-fb6ce962e34f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.811994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.812728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.813013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.815302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.815302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] RBAC: Adding query filter params (interface=public, service_id=d578c570a9a843ab93ff00f54ef3ab02, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:18.815302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.815766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:18.822021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 504/1036] 10.222.0.75 () {56 vars in 1251 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/endpoints?service_id=d578c570a9a843ab93ff00f54ef3ab02&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:18.827824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.843439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.844388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.845204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.845841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.854814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.856550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:51:18.869355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:18.870539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:51:18.871665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:18.875312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 533/1037] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:18.876214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:18.953109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331b8b9-2731-4e9a-80f4-8c24188f76a0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:18.980328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:18.992981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5da3d-eb05-429c-a0dd-6defe6c8e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:18.993681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5da3d-eb05-429c-a0dd-6defe6c8e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:18.993965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5da3d-eb05-429c-a0dd-6defe6c8e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:18.998169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5da3d-eb05-429c-a0dd-6defe6c8e2e8 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:18.998169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5da3d-eb05-429c-a0dd-6defe6c8e2e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:18.998169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5da3d-eb05-429c-a0dd-6defe6c8e2e8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:19.008509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 505/1038] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:51:19.008709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2de83d-1a41-4634-abd3-e51aee77cbdb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:19.054791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:19.055431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:19.055715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:19.055989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:19.056809 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:19.057121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:19.058631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:19.092453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 534/1039] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:51:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:19.094430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5da3d-eb05-429c-a0dd-6defe6c8e2e8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:19.208758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5da3d-eb05-429c-a0dd-6defe6c8e2e8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:19.250920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb2fe-4cca-4761-afd6-eaebd27c59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:19.251917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb2fe-4cca-4761-afd6-eaebd27c59bd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:19.252405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb2fe-4cca-4761-afd6-eaebd27c59bd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:19.253895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb2fe-4cca-4761-afd6-eaebd27c59bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:19.317321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:19.332118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdb2fe-4cca-4761-afd6-eaebd27c59bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:19.333591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdb2fe-4cca-4761-afd6-eaebd27c59bd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:19.451921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 506/1040] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:19 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:19.454043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:19.470818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:19.564779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c270bb-f3cc-4d7a-a279-d7abffc84c4b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:19.602090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:19.602720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:19.602998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:19.603266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:19.614323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:19.615756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:19.630837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:19.631849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:19.637724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:19.637724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:19.637724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:19.637724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 535/1041] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:19.639427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb2fe-4cca-4761-afd6-eaebd27c59bd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:19.738292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:19.758535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb2fe-4cca-4761-afd6-eaebd27c59bd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:19.808035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:19.808691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:19.809385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:19.809385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:19.809958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:19.810264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:19.811661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:19.828945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 507/1042] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:19.831233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:19.901893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:19.944611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fe735-9d97-4d6d-a46e-f258bfb9bfd9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:19.981479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:19.982394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:19.982828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:19.983251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:19.990462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:19.992124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:51:20.003742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:20.004849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:20.005981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:51:20.005981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:51:20.005981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:51:20.005981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:51:20.005981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:51:20.005981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:51:20.005981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:20.005981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:20.012614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 536/1043] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:20.014136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:20.126656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423c00-7da8-49a2-b529-4db49f5c3956 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:20.163436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860a7a1-ccf0-4d3a-b998-433007f79e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:20.164711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860a7a1-ccf0-4d3a-b998-433007f79e5c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:20.165445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860a7a1-ccf0-4d3a-b998-433007f79e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:20.166159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860a7a1-ccf0-4d3a-b998-433007f79e5c None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:20.167478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860a7a1-ccf0-4d3a-b998-433007f79e5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:20.167955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860a7a1-ccf0-4d3a-b998-433007f79e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:20.169604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860a7a1-ccf0-4d3a-b998-433007f79e5c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:20.188514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 508/1044] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:20.190724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:20.302791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d0a4-0dbd-4a95-9458-4cfa296c88cc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:20.329685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:20.339463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8139dda-ade0-4812-b52d-5d83ac5c32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:20.347292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8139dda-ade0-4812-b52d-5d83ac5c32e2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:20.347292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8139dda-ade0-4812-b52d-5d83ac5c32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:20.347292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8139dda-ade0-4812-b52d-5d83ac5c32e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:20.347292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8139dda-ade0-4812-b52d-5d83ac5c32e2 None admin] RBAC: Adding query filter params (role.id=94543b29ba2f4cd58b29f88e0dd1052a, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ab4bb702760a4cd2b2cbf6f732b2360b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:20.347292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8139dda-ade0-4812-b52d-5d83ac5c32e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:20.347292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8139dda-ade0-4812-b52d-5d83ac5c32e2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:20.349895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 537/1045] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:20 2022] GET /identity/v3/role_assignments?user.id=ab4bb702760a4cd2b2cbf6f732b2360b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=94543b29ba2f4cd58b29f88e0dd1052a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:20.400095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a342b-5faf-4ad9-b228-c2d11b156097 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:20.400379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a342b-5faf-4ad9-b228-c2d11b156097 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:20.400688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a342b-5faf-4ad9-b228-c2d11b156097 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:20.402066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 509/1046] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:20.407995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dd195-192c-4277-9bc0-a4575b6df947 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:20.408279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dd195-192c-4277-9bc0-a4575b6df947 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:20.408592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dd195-192c-4277-9bc0-a4575b6df947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:20.431210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8f1dd195-192c-4277-9bc0-a4575b6df947 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:20.432472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8f1dd195-192c-4277-9bc0-a4575b6df947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:20.511377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 538/1047] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:20.786321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a342b-5faf-4ad9-b228-c2d11b156097 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:20.795431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:20.903702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a342b-5faf-4ad9-b228-c2d11b156097 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:20.939916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fad1c8-7284-4c85-813b-395f029957e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:20.940618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad1c8-7284-4c85-813b-395f029957e2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:20.940899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad1c8-7284-4c85-813b-395f029957e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:20.941172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad1c8-7284-4c85-813b-395f029957e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:20.951110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fad1c8-7284-4c85-813b-395f029957e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-34fad1c8-7284-4c85-813b-395f029957e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:20.956465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:20.957699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:20.958576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:20.959947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 510/1048] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:20.963771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dd195-192c-4277-9bc0-a4575b6df947 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:21.067803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dd195-192c-4277-9bc0-a4575b6df947 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:21.089776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:21.105009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5cc4e-3afe-4227-8417-355e7b8a2171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:21.105624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5cc4e-3afe-4227-8417-355e7b8a2171 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:21.105903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5cc4e-3afe-4227-8417-355e7b8a2171 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:21.106175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5cc4e-3afe-4227-8417-355e7b8a2171 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:21.107654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5cc4e-3afe-4227-8417-355e7b8a2171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:21.107654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5cc4e-3afe-4227-8417-355e7b8a2171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:21.108599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5cc4e-3afe-4227-8417-355e7b8a2171 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:21.122382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 539/1049] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:21.123722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fad1c8-7284-4c85-813b-395f029957e2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:21.208292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:21.246086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fad1c8-7284-4c85-813b-395f029957e2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:21.259132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc4e3-1906-4a13-8a17-362e8302ce50 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:21.259474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc4e3-1906-4a13-8a17-362e8302ce50 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:21.259704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc4e3-1906-4a13-8a17-362e8302ce50 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:21.261296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 540/1050] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:51:21.266802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249816f7-0be1-4138-9ed2-13c73fc5ea7f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:21.267098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249816f7-0be1-4138-9ed2-13c73fc5ea7f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:21.267371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249816f7-0be1-4138-9ed2-13c73fc5ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:21.286796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-249816f7-0be1-4138-9ed2-13c73fc5ea7f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:21.288013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-249816f7-0be1-4138-9ed2-13c73fc5ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:21.289175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda0ed2-f8db-430c-befe-0860644702e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:21.289815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda0ed2-f8db-430c-befe-0860644702e1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:21.290297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda0ed2-f8db-430c-befe-0860644702e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:21.290575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda0ed2-f8db-430c-befe-0860644702e1 None admin] PATH_INFO: `/v3/users/48621e4b73f14aad9ac683fa1840d50a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:21.307771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda0ed2-f8db-430c-befe-0860644702e1 None admin] RBAC: Authorizing `identity:get_user(user_id=48621e4b73f14aad9ac683fa1840d50a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:21.309814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda0ed2-f8db-430c-befe-0860644702e1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:21.319902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 511/1051] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:21 2022] GET /identity/v3/users/48621e4b73f14aad9ac683fa1840d50a => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:21.320674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda0ed2-f8db-430c-befe-0860644702e1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:21.365659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 541/1052] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:51:21.433850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda0ed2-f8db-430c-befe-0860644702e1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:21.464190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:21.474887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b496fff-6d58-4423-a0e5-9555554325ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:21.475569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b496fff-6d58-4423-a0e5-9555554325ec None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:21.475855 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b496fff-6d58-4423-a0e5-9555554325ec None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:21.476128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b496fff-6d58-4423-a0e5-9555554325ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:21.550937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b496fff-6d58-4423-a0e5-9555554325ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:21.552385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b496fff-6d58-4423-a0e5-9555554325ec None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:21.641276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249816f7-0be1-4138-9ed2-13c73fc5ea7f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:21.660414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 512/1053] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:51:21.661472 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b496fff-6d58-4423-a0e5-9555554325ec None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:21.689006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:21.749531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249816f7-0be1-4138-9ed2-13c73fc5ea7f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:21.766216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:21.780398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b496fff-6d58-4423-a0e5-9555554325ec None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:21.790186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:21.790825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:21.791102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:21.791364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] PATH_INFO: `/v3/services/image` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:21.791943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:21.793339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:21.802632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:21.803827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:51:21.804974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:21.810950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 542/1054] 10.222.0.75 () {56 vars in 1105 bytes} [Mon Sep 19 14:51:21 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:21.817402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:21.828826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c07ec8-caf4-46e2-aecd-5d9462b1134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:21.829480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c07ec8-caf4-46e2-aecd-5d9462b1134a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:21.829761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c07ec8-caf4-46e2-aecd-5d9462b1134a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:21.830036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c07ec8-caf4-46e2-aecd-5d9462b1134a None admin] PATH_INFO: `/v3/projects/84c0817ddb0a43df8486657cbfa701e7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:21.832641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c07ec8-caf4-46e2-aecd-5d9462b1134a None admin] RBAC: Authorizing `identity:get_project(project_id=84c0817ddb0a43df8486657cbfa701e7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:21.834612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c07ec8-caf4-46e2-aecd-5d9462b1134a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:21.836079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 513/1055] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:21 2022] GET /identity/v3/projects/84c0817ddb0a43df8486657cbfa701e7 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:21.842175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c07ec8-caf4-46e2-aecd-5d9462b1134a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:21.927473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6d42-2953-4c11-82fe-d9ad762bb3bc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:21.953697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:21.970874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:21.971087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c07ec8-caf4-46e2-aecd-5d9462b1134a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:21.971709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:21.972006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:21.972340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:21.973036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] RBAC: Adding query filter params (name=image) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:21.973340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:21.974717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:21.984855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 543/1056] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:21.986145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:22.015420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:22.015696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:22.016001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:22.016280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:22.017045 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=84c0817ddb0a43df8486657cbfa701e7, user.id=48621e4b73f14aad9ac683fa1840d50a) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:22.017353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:22.019393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:22.025894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 514/1057] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:21 2022] GET /identity/v3/role_assignments?user.id=48621e4b73f14aad9ac683fa1840d50a&scope.project.id=84c0817ddb0a43df8486657cbfa701e7&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:22.054303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:22.123257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41568c-eb09-47f0-af3f-95fe170e1a09 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:22.163156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad0664-2879-4e48-9bb5-3cb37e82fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:22.163783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0664-2879-4e48-9bb5-3cb37e82fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:22.164059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0664-2879-4e48-9bb5-3cb37e82fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:22.164328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0664-2879-4e48-9bb5-3cb37e82fbb0 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:22.164998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0664-2879-4e48-9bb5-3cb37e82fbb0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:22.165300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0664-2879-4e48-9bb5-3cb37e82fbb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:22.166669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0664-2879-4e48-9bb5-3cb37e82fbb0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:22.176527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 544/1058] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:22.180649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:22.291566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d568ca-cebd-4f3d-9e8b-f533b0d7baf4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:22.329427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d4b41-3ead-403d-bc4b-bc103a8a3cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:22.330415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d4b41-3ead-403d-bc4b-bc103a8a3cf2 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:22.330990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d4b41-3ead-403d-bc4b-bc103a8a3cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:22.331487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d4b41-3ead-403d-bc4b-bc103a8a3cf2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:22.332378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d4b41-3ead-403d-bc4b-bc103a8a3cf2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:22.334280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d4b41-3ead-403d-bc4b-bc103a8a3cf2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:22.424134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 515/1059] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:51:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:22.596045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722830-1c3e-40ed-a6fa-78e74e4ec86a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:22.596996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722830-1c3e-40ed-a6fa-78e74e4ec86a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:22.597166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722830-1c3e-40ed-a6fa-78e74e4ec86a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:22.598698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 545/1060] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:22.604560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdf903-27a8-43c4-bade-380851d963bb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:22.604560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdf903-27a8-43c4-bade-380851d963bb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:22.604560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdf903-27a8-43c4-bade-380851d963bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:22.624715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e0bdf903-27a8-43c4-bade-380851d963bb None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:22.625917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e0bdf903-27a8-43c4-bade-380851d963bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:22.635283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:22.712708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 516/1061] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:22.984356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722830-1c3e-40ed-a6fa-78e74e4ec86a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:23.123066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722830-1c3e-40ed-a6fa-78e74e4ec86a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:23.125449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:23.158917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2cad6-40d4-4a0a-a6fc-bc9cd5c58e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:23.159687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2cad6-40d4-4a0a-a6fc-bc9cd5c58e5a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:23.160624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2cad6-40d4-4a0a-a6fc-bc9cd5c58e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:23.161267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2cad6-40d4-4a0a-a6fc-bc9cd5c58e5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:23.178656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2cad6-40d4-4a0a-a6fc-bc9cd5c58e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e1d2cad6-40d4-4a0a-a6fc-bc9cd5c58e5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:23.183599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:23.184812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:23.185712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:23.186907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 546/1062] 10.222.0.75 () {56 vars in 1120 bytes} [Mon Sep 19 14:51:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:23.191760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdf903-27a8-43c4-bade-380851d963bb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:23.301200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdf903-27a8-43c4-bade-380851d963bb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:23.336262 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:23.337176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:23.337463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:23.337733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:23.338416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:23.338717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:23.340071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:23.345688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:23.362635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 517/1063] 10.222.0.75 () {56 vars in 1115 bytes} [Mon Sep 19 14:51:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:23.372855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2cad6-40d4-4a0a-a6fc-bc9cd5c58e5a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:23.506468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2cad6-40d4-4a0a-a6fc-bc9cd5c58e5a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:23.541855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:23.542486 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:23.542766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:23.543038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:23.555502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:23.556917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:23.571621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:23.572948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:23.573876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:23.573876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:23.573876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:23.574453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 547/1064] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:23.578557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:23.690358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884987b-15de-4499-a349-c5610f3b5c43 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:23.747930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:23.749137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:23.749137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:23.749137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:23.751597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:23.751597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:23.751597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:23.765594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 518/1065] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:23.772045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:23.793612 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:23.883340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1323-3e1b-48b6-8276-0730dddc67d8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:23.918212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:23.918844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:23.919118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:23.919428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:23.928118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:23.929595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:51:23.941354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:23.942330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:51:23.943284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:23.944571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 548/1066] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:51:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:23.948322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:24.009569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:24.055534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc3bc0-8ebf-4046-9865-be09d6109567 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:24.097743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c964a-6259-480d-b761-774ac81bd511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:24.098438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c964a-6259-480d-b761-774ac81bd511 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.098846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c964a-6259-480d-b761-774ac81bd511 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.099185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c964a-6259-480d-b761-774ac81bd511 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.100557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c964a-6259-480d-b761-774ac81bd511 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:24.101121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c964a-6259-480d-b761-774ac81bd511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:24.103754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c964a-6259-480d-b761-774ac81bd511 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:24.130134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 519/1067] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:51:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:24.131551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:24.217948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:24.238827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0a0e-dc56-4c42-a4c9-5e7a5dbeb925 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.239425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0a0e-dc56-4c42-a4c9-5e7a5dbeb925 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.239425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0a0e-dc56-4c42-a4c9-5e7a5dbeb925 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.240757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 520/1068] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:24.245670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915553-dbc8-438d-b15c-77bf3cc8b075 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:24.246413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89a22-53e3-4e6c-b08d-59f384b932c9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.246894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89a22-53e3-4e6c-b08d-59f384b932c9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.247397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89a22-53e3-4e6c-b08d-59f384b932c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.270304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a2e89a22-53e3-4e6c-b08d-59f384b932c9 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:24.271527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a2e89a22-53e3-4e6c-b08d-59f384b932c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:24.288509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:24.289167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.289451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.289726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.300987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:24.303015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:24.318474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:24.320652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:24.321585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:24.321585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:24.321585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:24.321585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 549/1069] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:24.325424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:24.353944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 521/1070] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:24.433855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60686577-b59e-4fee-94fd-3c4d0d9942ef None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:24.462780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:24.471121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:24.471742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.472026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.472299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.473038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:24.473350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:24.474735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:24.487945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 550/1071] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:24.493546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e89a22-53e3-4e6c-b08d-59f384b932c9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:24.548643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:24.608593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e89a22-53e3-4e6c-b08d-59f384b932c9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:24.628148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:24.648657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1846221-4e29-4457-9368-3289863b5b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:24.649623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1846221-4e29-4457-9368-3289863b5b4b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.650084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1846221-4e29-4457-9368-3289863b5b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.650554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1846221-4e29-4457-9368-3289863b5b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.658426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1846221-4e29-4457-9368-3289863b5b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:24.661078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1846221-4e29-4457-9368-3289863b5b4b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b1846221-4e29-4457-9368-3289863b5b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:51:24.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:24.674704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:24.676164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 522/1072] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:24.676696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41bdb7-f7f5-4745-b973-ca59de2b3730 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.676696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41bdb7-f7f5-4745-b973-ca59de2b3730 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.677258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41bdb7-f7f5-4745-b973-ca59de2b3730 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.678294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 523/1073] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:24.681322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41bdb7-f7f5-4745-b973-ca59de2b3730 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:24.737963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbb7b3-0a3f-4ca6-82e3-8c6c612c85b1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:24.777174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd603cce-a173-4020-bf57-5a0649a124ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:24.777795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd603cce-a173-4020-bf57-5a0649a124ed None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.778070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd603cce-a173-4020-bf57-5a0649a124ed None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.778338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd603cce-a173-4020-bf57-5a0649a124ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.789630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd603cce-a173-4020-bf57-5a0649a124ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:24.790981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41bdb7-f7f5-4745-b973-ca59de2b3730 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-bd603cce-a173-4020-bf57-5a0649a124ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:24.794432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:24.795371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:24.796213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 551/1074] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:24.797224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa3b45-0986-4133-8e35-9a5441ec2e9c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.797224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa3b45-0986-4133-8e35-9a5441ec2e9c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.797442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa3b45-0986-4133-8e35-9a5441ec2e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.802191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:24.817069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-86fa3b45-0986-4133-8e35-9a5441ec2e9c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:24.818268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-86fa3b45-0986-4133-8e35-9a5441ec2e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:24.826598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:24.827210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.827490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.827763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.828473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:24.828802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:24.830228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:24.842844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 524/1075] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:24.843866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:24.868253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:24.895693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 552/1076] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:24.896647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa3b45-0986-4133-8e35-9a5441ec2e9c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:24.958561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77e0a-657d-4d9f-9c14-1fb366cf3890 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:24.997421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:24.997945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:24.998224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:24.998494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:24.999147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:24.999446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:25.000906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:25.015128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 525/1077] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:25.015307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa3b45-0986-4133-8e35-9a5441ec2e9c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:25.016308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:25.048398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:25.051214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4046-6c6a-4916-ac45-6bd2be4d11b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:25.052204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4046-6c6a-4916-ac45-6bd2be4d11b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:25.052708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4046-6c6a-4916-ac45-6bd2be4d11b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:25.053218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4046-6c6a-4916-ac45-6bd2be4d11b8 None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ab4bb702760a4cd2b2cbf6f732b2360b/roles/94543b29ba2f4cd58b29f88e0dd1052a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:25.055640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4046-6c6a-4916-ac45-6bd2be4d11b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=ab4bb702760a4cd2b2cbf6f732b2360b, role_id=94543b29ba2f4cd58b29f88e0dd1052a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:25.057424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4046-6c6a-4916-ac45-6bd2be4d11b8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:25.123282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada994b-dcd4-41fe-b4f7-73c2bc9757f2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:25.144907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 553/1078] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:51:24 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/ab4bb702760a4cd2b2cbf6f732b2360b/roles/94543b29ba2f4cd58b29f88e0dd1052a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:51:25.161379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d42c1-54ab-49fc-94d2-dcb86b867a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:25.162300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d42c1-54ab-49fc-94d2-dcb86b867a0c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:25.162799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d42c1-54ab-49fc-94d2-dcb86b867a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:25.163227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d42c1-54ab-49fc-94d2-dcb86b867a0c None admin] PATH_INFO: `/v3/users/48621e4b73f14aad9ac683fa1840d50a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:25.164808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d42c1-54ab-49fc-94d2-dcb86b867a0c None admin] RBAC: Authorizing `identity:get_user(user_id=48621e4b73f14aad9ac683fa1840d50a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:25.166513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d42c1-54ab-49fc-94d2-dcb86b867a0c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:25.169097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 526/1079] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:25 2022] GET /identity/v3/users/48621e4b73f14aad9ac683fa1840d50a => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:25.173726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4046-6c6a-4916-ac45-6bd2be4d11b8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:25.175632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d42c1-54ab-49fc-94d2-dcb86b867a0c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:25.228639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:25.290529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:25.294335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d42c1-54ab-49fc-94d2-dcb86b867a0c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:25.313030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4046-6c6a-4916-ac45-6bd2be4d11b8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:25.336247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea69882-d94c-4634-bd7c-c14f0594d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:25.336762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea69882-d94c-4634-bd7c-c14f0594d885 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:25.338890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea69882-d94c-4634-bd7c-c14f0594d885 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:25.338890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea69882-d94c-4634-bd7c-c14f0594d885 None admin] PATH_INFO: `/v3/projects/84c0817ddb0a43df8486657cbfa701e7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:25.339168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea69882-d94c-4634-bd7c-c14f0594d885 None admin] RBAC: Authorizing `identity:get_project(project_id=84c0817ddb0a43df8486657cbfa701e7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:25.341382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea69882-d94c-4634-bd7c-c14f0594d885 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:25.343036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 527/1080] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:25 2022] GET /identity/v3/projects/84c0817ddb0a43df8486657cbfa701e7 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:25.349642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea69882-d94c-4634-bd7c-c14f0594d885 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:25.357574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f649a50-31c1-4ea4-88fd-20ea69c99bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:25.358246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649a50-31c1-4ea4-88fd-20ea69c99bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:25.358532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649a50-31c1-4ea4-88fd-20ea69c99bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:25.358804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f649a50-31c1-4ea4-88fd-20ea69c99bd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:25.439089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f649a50-31c1-4ea4-88fd-20ea69c99bd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:25.440617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f649a50-31c1-4ea4-88fd-20ea69c99bd2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:25.466733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea69882-d94c-4634-bd7c-c14f0594d885 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:25.488500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:25.505915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cb0c0-1c50-4581-a17a-de182a799c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:25.506593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb0c0-1c50-4581-a17a-de182a799c71 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:25.506877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb0c0-1c50-4581-a17a-de182a799c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:25.507160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb0c0-1c50-4581-a17a-de182a799c71 None admin] PATH_INFO: `/v3/projects/84c0817ddb0a43df8486657cbfa701e7/users/48621e4b73f14aad9ac683fa1840d50a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:25.509245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cb0c0-1c50-4581-a17a-de182a799c71 None admin] RBAC: Authorizing `identity:create_grant(project_id=84c0817ddb0a43df8486657cbfa701e7, user_id=48621e4b73f14aad9ac683fa1840d50a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:25.510785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cb0c0-1c50-4581-a17a-de182a799c71 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:25.555882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 554/1081] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:25.561748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f649a50-31c1-4ea4-88fd-20ea69c99bd2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:25.620780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 528/1082] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:51:25 2022] PUT /identity/v3/projects/84c0817ddb0a43df8486657cbfa701e7/users/48621e4b73f14aad9ac683fa1840d50a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:51:25.693147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f649a50-31c1-4ea4-88fd-20ea69c99bd2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:25.732687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53d78b-ff35-448b-b9e1-94d2e80fed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:25.733340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d78b-ff35-448b-b9e1-94d2e80fed49 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:25.733623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d78b-ff35-448b-b9e1-94d2e80fed49 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:25.733898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53d78b-ff35-448b-b9e1-94d2e80fed49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:25.741510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:25.746478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53d78b-ff35-448b-b9e1-94d2e80fed49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:25.747967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53d78b-ff35-448b-b9e1-94d2e80fed49 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4a53d78b-ff35-448b-b9e1-94d2e80fed49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:25.770995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:25.772079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:25.773231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:25.773231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:25.773231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:25.773231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 555/1083] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:25.780422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cb0c0-1c50-4581-a17a-de182a799c71 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:25.812692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:25.890730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cb0c0-1c50-4581-a17a-de182a799c71 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:25.929329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3907f4-46bf-49f3-aa92-62ef767c29d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:25.929954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3907f4-46bf-49f3-aa92-62ef767c29d4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:25.930235 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3907f4-46bf-49f3-aa92-62ef767c29d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:25.930509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3907f4-46bf-49f3-aa92-62ef767c29d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:25.931157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3907f4-46bf-49f3-aa92-62ef767c29d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:25.931461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3907f4-46bf-49f3-aa92-62ef767c29d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:25.932841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3907f4-46bf-49f3-aa92-62ef767c29d4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:25.952525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 529/1084] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:27.378892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588197f9-739e-413b-86e7-4b920263baa3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:27.379482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588197f9-739e-413b-86e7-4b920263baa3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:27.379482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588197f9-739e-413b-86e7-4b920263baa3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:27.380812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 556/1085] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:27.386120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eaba3-254c-42c4-8e63-4e32da9459f7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:27.386566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eaba3-254c-42c4-8e63-4e32da9459f7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:27.386664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eaba3-254c-42c4-8e63-4e32da9459f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:27.405180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-089eaba3-254c-42c4-8e63-4e32da9459f7 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:27.406384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-089eaba3-254c-42c4-8e63-4e32da9459f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:27.477681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 530/1086] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:27.751712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588197f9-739e-413b-86e7-4b920263baa3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:27.819352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d344e8-d7e6-4522-8edc-dd337a0e69bb None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:27.819631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d344e8-d7e6-4522-8edc-dd337a0e69bb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:27.819908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d344e8-d7e6-4522-8edc-dd337a0e69bb None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:27.821271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 531/1087] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:27.826100 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182383-0fe3-427b-81cc-628166192e7e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:27.826383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182383-0fe3-427b-81cc-628166192e7e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:27.826658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182383-0fe3-427b-81cc-628166192e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:27.845162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ab182383-0fe3-427b-81cc-628166192e7e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:27.846442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ab182383-0fe3-427b-81cc-628166192e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:27.858932 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:27.859886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588197f9-739e-413b-86e7-4b920263baa3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:27.896572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4539-885d-4216-9ed1-3a55014616a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:27.897212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4539-885d-4216-9ed1-3a55014616a6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:27.897502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4539-885d-4216-9ed1-3a55014616a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:27.897778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4539-885d-4216-9ed1-3a55014616a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:27.908878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4539-885d-4216-9ed1-3a55014616a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-fb3f4539-885d-4216-9ed1-3a55014616a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:27.913635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:27.914790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:27.916457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 557/1088] 10.222.0.75 () {56 vars in 1120 bytes} [Mon Sep 19 14:51:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:27.919069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 532/1089] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:51:27.921210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4539-885d-4216-9ed1-3a55014616a6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:27.972442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:28.026229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4539-885d-4216-9ed1-3a55014616a6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.063488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.063488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.063488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.063488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.063991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:28.064278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:28.066409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:28.075161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 558/1090] 10.222.0.75 () {56 vars in 1115 bytes} [Mon Sep 19 14:51:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:28.082088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182383-0fe3-427b-81cc-628166192e7e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.196120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182383-0fe3-427b-81cc-628166192e7e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.202730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.231638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.232273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.232583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.232859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.243804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:28.245271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:28.251984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:28.261201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:28.272078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:28.273002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:28.273002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:28.273002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:28.273002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 533/1091] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:28.273002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.312353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a978ab-3a6e-463e-8812-687c17f8539d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.325954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:28.348998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0784-0e54-44c0-8c84-ba997a1aaf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.349688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0784-0e54-44c0-8c84-ba997a1aaf08 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.350107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0784-0e54-44c0-8c84-ba997a1aaf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.350430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0784-0e54-44c0-8c84-ba997a1aaf08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.361322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f0784-0e54-44c0-8c84-ba997a1aaf08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-fa8f0784-0e54-44c0-8c84-ba997a1aaf08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:28.366678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:28.367605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:28.368574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 559/1092] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:28.373349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26f274-87df-4b49-a761-c5a4513ee500 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.373706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0784-0e54-44c0-8c84-ba997a1aaf08 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.411951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.412618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.412873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.413150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.413808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:28.414114 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:28.415478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:28.428252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 534/1093] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:28.434069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.488611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0784-0e54-44c0-8c84-ba997a1aaf08 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.495247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:28.523625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.524421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.524735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.525009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.525709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:28.526009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:28.527403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:28.540003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 560/1094] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:28.541041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475536fb-7726-496d-a71a-cf71508a8012 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.546669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.584043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.584621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.584900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.585171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.585626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:28.593085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:28.597462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:51:28.607616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:28.608857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:28.610053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 535/1095] 10.222.0.75 () {56 vars in 1093 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:51:28.615524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.656850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae2feb-225b-4160-9e71-2cf36a8eea0a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.696251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba863b-7168-4659-b316-1069f254d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.696906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba863b-7168-4659-b316-1069f254d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.697182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba863b-7168-4659-b316-1069f254d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.697446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba863b-7168-4659-b316-1069f254d6a3 None admin] PATH_INFO: `/v3/users/48621e4b73f14aad9ac683fa1840d50a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.698576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba863b-7168-4659-b316-1069f254d6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=48621e4b73f14aad9ac683fa1840d50a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:28.700004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba863b-7168-4659-b316-1069f254d6a3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:28.701602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 561/1096] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/users/48621e4b73f14aad9ac683fa1840d50a => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:28.707645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba863b-7168-4659-b316-1069f254d6a3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.722857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a735-e451-468d-ad2c-d45f79319ac3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.740535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:28.758518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.759126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.759401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.759676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.760403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:28.760742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:28.762170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:28.780398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 536/1097] 10.222.0.75 () {56 vars in 1133 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:28.786987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:28.820186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba863b-7168-4659-b316-1069f254d6a3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.821804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:28.856886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42162c33-7c01-40cc-ab2d-2a822c26eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.857407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162c33-7c01-40cc-ab2d-2a822c26eeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.857688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162c33-7c01-40cc-ab2d-2a822c26eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.857961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162c33-7c01-40cc-ab2d-2a822c26eeb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.894989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342b92-fb62-4550-9588-c533ae04a047 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:28.930622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42162c33-7c01-40cc-ab2d-2a822c26eeb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:28.931706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad82e9b-3916-4aa0-bca1-61a27aae4dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:28.932133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42162c33-7c01-40cc-ab2d-2a822c26eeb2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:28.932323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad82e9b-3916-4aa0-bca1-61a27aae4dab None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:28.932637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad82e9b-3916-4aa0-bca1-61a27aae4dab None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:28.932915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad82e9b-3916-4aa0-bca1-61a27aae4dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:28.977928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:29.002942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad82e9b-3916-4aa0-bca1-61a27aae4dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:29.004391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad82e9b-3916-4aa0-bca1-61a27aae4dab None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:29.036762 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 562/1098] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:29.042782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42162c33-7c01-40cc-ab2d-2a822c26eeb2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:29.044718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:29.123159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 537/1099] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:51:29.131351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad82e9b-3916-4aa0-bca1-61a27aae4dab None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:29.150103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42162c33-7c01-40cc-ab2d-2a822c26eeb2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:29.185711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7416-0bd0-4798-8864-847841eda9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:29.186334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7416-0bd0-4798-8864-847841eda9fa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:29.186613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7416-0bd0-4798-8864-847841eda9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:29.186880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7416-0bd0-4798-8864-847841eda9fa None admin] PATH_INFO: `/v3/projects/84c0817ddb0a43df8486657cbfa701e7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:29.187983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7416-0bd0-4798-8864-847841eda9fa None admin] RBAC: Authorizing `identity:get_project(project_id=84c0817ddb0a43df8486657cbfa701e7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:29.189434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a7416-0bd0-4798-8864-847841eda9fa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:29.191916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 563/1100] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:29 2022] GET /identity/v3/projects/84c0817ddb0a43df8486657cbfa701e7 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:29.198095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7416-0bd0-4798-8864-847841eda9fa None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:29.216095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:29.240625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad82e9b-3916-4aa0-bca1-61a27aae4dab None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:29.277231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:29.277865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:29.277981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:29.278144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:29.278413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:29.289341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:29.290789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:29.302239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a7416-0bd0-4798-8864-847841eda9fa None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:51:29.305878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:29.306966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:51:29.307900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:51:29.307900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:51:29.307900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:29.307900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 538/1101] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:29.312651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:29.338011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:29.338616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:29.339000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:29.339275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:29.340036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=84c0817ddb0a43df8486657cbfa701e7, user.id=48621e4b73f14aad9ac683fa1840d50a) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:29.340342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:29.341805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:29.348639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 564/1102] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:29 2022] GET /identity/v3/role_assignments?user.id=48621e4b73f14aad9ac683fa1840d50a&scope.project.id=84c0817ddb0a43df8486657cbfa701e7&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:29.431066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad3561-3f2a-4349-a9cf-8ea8234f063c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:29.460420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:29.476974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:29.477609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:29.477898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:29.478175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:29.478849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:29.479158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:29.480685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:29.494180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 539/1103] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:29.500039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:29.610400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be92e9a-3f10-4be8-ade3-2bfd068fc8f9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:29.647339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:29.647978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:29.648266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:29.648569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:29.650490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:29.655980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:29.657625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:51:29.670470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:29.671441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:29.672361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:51:29.672361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:51:29.672361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:51:29.672361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:51:29.672361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:51:29.672361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:51:29.672361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:51:29.672361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:29.673380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 565/1104] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:29.678349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:29.783178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bf353-7e27-45aa-aa16-5580e48e0991 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:29.818350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16954b8-9cfc-407c-a4eb-413f382d71d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:29.818975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16954b8-9cfc-407c-a4eb-413f382d71d6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:29.819260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16954b8-9cfc-407c-a4eb-413f382d71d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:29.819539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16954b8-9cfc-407c-a4eb-413f382d71d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:29.820347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16954b8-9cfc-407c-a4eb-413f382d71d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:29.820686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16954b8-9cfc-407c-a4eb-413f382d71d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:29.822145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16954b8-9cfc-407c-a4eb-413f382d71d6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:29.834255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 540/1105] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:29.841011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:29.946946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad725-6a65-4050-9d0b-430b0e1f37cf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:29.987154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76a420-3cf0-49d6-a461-2b4f09e1e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:29.988185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a420-3cf0-49d6-a461-2b4f09e1e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:29.988185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a420-3cf0-49d6-a461-2b4f09e1e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:29.988432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a420-3cf0-49d6-a461-2b4f09e1e6e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:29.989215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76a420-3cf0-49d6-a461-2b4f09e1e6e1 None admin] RBAC: Adding query filter params (role.id=94543b29ba2f4cd58b29f88e0dd1052a, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=ab4bb702760a4cd2b2cbf6f732b2360b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:29.989517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76a420-3cf0-49d6-a461-2b4f09e1e6e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:29.990934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76a420-3cf0-49d6-a461-2b4f09e1e6e1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:29.996642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 566/1106] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:29 2022] GET /identity/v3/role_assignments?user.id=ab4bb702760a4cd2b2cbf6f732b2360b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=94543b29ba2f4cd58b29f88e0dd1052a => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:51:31.589031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596e07a-1413-445d-8e14-869b058cf3ec None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:31.589603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596e07a-1413-445d-8e14-869b058cf3ec None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:31.589603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596e07a-1413-445d-8e14-869b058cf3ec None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:31.590944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 541/1107] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:31.597115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e3c0-0a32-43b8-801d-c217126c8fb8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:31.597666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e3c0-0a32-43b8-801d-c217126c8fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:31.597666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e3c0-0a32-43b8-801d-c217126c8fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:31.617282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5887e3c0-0a32-43b8-801d-c217126c8fb8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:31.618505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5887e3c0-0a32-43b8-801d-c217126c8fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:31.676307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:31.691220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 567/1108] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:31.981739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596e07a-1413-445d-8e14-869b058cf3ec None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:32.036492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:32.091971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596e07a-1413-445d-8e14-869b058cf3ec None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:32.131723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93da7ac-5058-4fcc-89b7-3005a67420d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:32.132371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da7ac-5058-4fcc-89b7-3005a67420d7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:32.132850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da7ac-5058-4fcc-89b7-3005a67420d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:32.133135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da7ac-5058-4fcc-89b7-3005a67420d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:32.134299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93da7ac-5058-4fcc-89b7-3005a67420d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:32.135735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93da7ac-5058-4fcc-89b7-3005a67420d7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:32.137365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 542/1109] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:32.144064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887e3c0-0a32-43b8-801d-c217126c8fb8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:32.252273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887e3c0-0a32-43b8-801d-c217126c8fb8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:32.286498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e5c28-a918-4dd6-81b2-bd07a18b0e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:32.287092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e5c28-a918-4dd6-81b2-bd07a18b0e6e None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:32.287410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e5c28-a918-4dd6-81b2-bd07a18b0e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:32.287680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e5c28-a918-4dd6-81b2-bd07a18b0e6e None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:32.288339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e5c28-a918-4dd6-81b2-bd07a18b0e6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:32.289797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e5c28-a918-4dd6-81b2-bd07a18b0e6e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:32.423681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 568/1110] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:51:32 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:34.666061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cac4c-f754-4113-8076-4d665d2369d1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:34.666628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cac4c-f754-4113-8076-4d665d2369d1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:34.666628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cac4c-f754-4113-8076-4d665d2369d1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:34.668003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 543/1111] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:34.673501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9931-ad96-4b08-9380-bfd3912609b6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:34.673992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9931-ad96-4b08-9380-bfd3912609b6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:34.674109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9931-ad96-4b08-9380-bfd3912609b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:34.692864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5e7c9931-ad96-4b08-9380-bfd3912609b6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:34.694072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5e7c9931-ad96-4b08-9380-bfd3912609b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:34.737986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:34.764895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 569/1112] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:51:35.039559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cac4c-f754-4113-8076-4d665d2369d1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.151785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cac4c-f754-4113-8076-4d665d2369d1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:35.168686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:35.186834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60a6ef-d5c6-493e-b196-2bbf4692ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:35.187470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a6ef-d5c6-493e-b196-2bbf4692ddca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.187754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a6ef-d5c6-493e-b196-2bbf4692ddca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.188025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a6ef-d5c6-493e-b196-2bbf4692ddca None admin] PATH_INFO: `/v3/roles/3b586edbe9c24d7288ee1a8e48781662` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.189436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60a6ef-d5c6-493e-b196-2bbf4692ddca None admin] RBAC: Authorizing `identity:get_role(role_id=3b586edbe9c24d7288ee1a8e48781662)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:35.190818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60a6ef-d5c6-493e-b196-2bbf4692ddca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:35.192246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 544/1113] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:35 2022] GET /identity/v3/roles/3b586edbe9c24d7288ee1a8e48781662 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:35.198129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9931-ad96-4b08-9380-bfd3912609b6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.296862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9931-ad96-4b08-9380-bfd3912609b6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:35.331639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747788f-d540-4cec-9ca8-c469c8d511f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:35.332267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747788f-d540-4cec-9ca8-c469c8d511f0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.332575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747788f-d540-4cec-9ca8-c469c8d511f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.332855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747788f-d540-4cec-9ca8-c469c8d511f0 None admin] PATH_INFO: `/v3/users/861a1fbec79a4083b76758d7ed5ce36d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.346505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747788f-d540-4cec-9ca8-c469c8d511f0 None admin] RBAC: Authorizing `identity:get_user(user_id=861a1fbec79a4083b76758d7ed5ce36d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:35.347946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747788f-d540-4cec-9ca8-c469c8d511f0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:35.349621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 570/1114] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:35 2022] GET /identity/v3/users/861a1fbec79a4083b76758d7ed5ce36d => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:35.355720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60a6ef-d5c6-493e-b196-2bbf4692ddca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.456267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60a6ef-d5c6-493e-b196-2bbf4692ddca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:35.496212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcce42-b59f-4c34-ab9a-c4078fa5cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:35.496854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcce42-b59f-4c34-ab9a-c4078fa5cec9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.497139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcce42-b59f-4c34-ab9a-c4078fa5cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.497441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcce42-b59f-4c34-ab9a-c4078fa5cec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.550368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:35.567206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcce42-b59f-4c34-ab9a-c4078fa5cec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:35.568985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcce42-b59f-4c34-ab9a-c4078fa5cec9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:35.667743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 545/1115] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:35.673858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747788f-d540-4cec-9ca8-c469c8d511f0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.706114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:35.776054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747788f-d540-4cec-9ca8-c469c8d511f0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:35.812609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026d5af-3a5f-4bcf-9fe9-981e0784246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:35.813242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026d5af-3a5f-4bcf-9fe9-981e0784246d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.813517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026d5af-3a5f-4bcf-9fe9-981e0784246d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.813790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026d5af-3a5f-4bcf-9fe9-981e0784246d None admin] PATH_INFO: `/v3/projects/84c0817ddb0a43df8486657cbfa701e7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.814948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026d5af-3a5f-4bcf-9fe9-981e0784246d None admin] RBAC: Authorizing `identity:get_project(project_id=84c0817ddb0a43df8486657cbfa701e7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:35.816372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026d5af-3a5f-4bcf-9fe9-981e0784246d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:35.818225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 571/1116] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:35 2022] GET /identity/v3/projects/84c0817ddb0a43df8486657cbfa701e7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:35.824629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcce42-b59f-4c34-ab9a-c4078fa5cec9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.907757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:35.923635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcce42-b59f-4c34-ab9a-c4078fa5cec9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:35.957069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22065b52-dfad-426c-91a5-1ed77ba6077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:35.957668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065b52-dfad-426c-91a5-1ed77ba6077d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.957954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065b52-dfad-426c-91a5-1ed77ba6077d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.958231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065b52-dfad-426c-91a5-1ed77ba6077d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.959044 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065b52-dfad-426c-91a5-1ed77ba6077d None admin] RBAC: Adding query filter params (role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=84c0817ddb0a43df8486657cbfa701e7, user.id=861a1fbec79a4083b76758d7ed5ce36d) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:35.959565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065b52-dfad-426c-91a5-1ed77ba6077d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:35.961292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065b52-dfad-426c-91a5-1ed77ba6077d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:35.967574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 546/1117] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:35 2022] GET /identity/v3/role_assignments?user.id=861a1fbec79a4083b76758d7ed5ce36d&scope.project.id=84c0817ddb0a43df8486657cbfa701e7&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:38.127032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c68f0-0ea7-4107-bfdb-a2306af5f8c1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:38.127572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c68f0-0ea7-4107-bfdb-a2306af5f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:38.127572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c68f0-0ea7-4107-bfdb-a2306af5f8c1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:38.128963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 572/1118] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:38.134226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c970695-9b3c-4d8e-91bb-b8371c25078e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:38.134666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c970695-9b3c-4d8e-91bb-b8371c25078e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:38.134768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c970695-9b3c-4d8e-91bb-b8371c25078e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:38.159567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9c970695-9b3c-4d8e-91bb-b8371c25078e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:38.160872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9c970695-9b3c-4d8e-91bb-b8371c25078e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:38.247705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 547/1119] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:38.520265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c68f0-0ea7-4107-bfdb-a2306af5f8c1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:38.626480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:38.630993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c68f0-0ea7-4107-bfdb-a2306af5f8c1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:38.666748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1221-62fc-4180-8b9b-be1538807009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:38.667396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1221-62fc-4180-8b9b-be1538807009 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:38.667678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1221-62fc-4180-8b9b-be1538807009 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:38.667952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1221-62fc-4180-8b9b-be1538807009 None admin] PATH_INFO: `/v3/roles/3b586edbe9c24d7288ee1a8e48781662` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:38.669392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1221-62fc-4180-8b9b-be1538807009 None admin] RBAC: Authorizing `identity:get_role(role_id=3b586edbe9c24d7288ee1a8e48781662)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:38.671248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd1221-62fc-4180-8b9b-be1538807009 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:38.674374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 573/1120] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:38 2022] GET /identity/v3/roles/3b586edbe9c24d7288ee1a8e48781662 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:38.681797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c970695-9b3c-4d8e-91bb-b8371c25078e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:38.762084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:38.785940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c970695-9b3c-4d8e-91bb-b8371c25078e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:38.831762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b6cdd-52f7-4d30-99ac-14368fa54179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:38.832901 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b6cdd-52f7-4d30-99ac-14368fa54179 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:38.833421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b6cdd-52f7-4d30-99ac-14368fa54179 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:38.833926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b6cdd-52f7-4d30-99ac-14368fa54179 None admin] PATH_INFO: `/v3/users/861a1fbec79a4083b76758d7ed5ce36d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:38.835471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b6cdd-52f7-4d30-99ac-14368fa54179 None admin] RBAC: Authorizing `identity:get_user(user_id=861a1fbec79a4083b76758d7ed5ce36d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:38.838219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b6cdd-52f7-4d30-99ac-14368fa54179 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:38.839864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 548/1121] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:38 2022] GET /identity/v3/users/861a1fbec79a4083b76758d7ed5ce36d => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:38.846187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1221-62fc-4180-8b9b-be1538807009 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:38.974254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1221-62fc-4180-8b9b-be1538807009 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:39.014270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f6281-b630-40a0-88d0-eec02230217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:39.015278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f6281-b630-40a0-88d0-eec02230217c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:39.015743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f6281-b630-40a0-88d0-eec02230217c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:39.016224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f6281-b630-40a0-88d0-eec02230217c None admin] PATH_INFO: `/v3/projects/84c0817ddb0a43df8486657cbfa701e7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:39.018115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f6281-b630-40a0-88d0-eec02230217c None admin] RBAC: Authorizing `identity:get_project(project_id=84c0817ddb0a43df8486657cbfa701e7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:39.020349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f6281-b630-40a0-88d0-eec02230217c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:39.022066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 574/1122] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:38 2022] GET /identity/v3/projects/84c0817ddb0a43df8486657cbfa701e7 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:39.028988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b6cdd-52f7-4d30-99ac-14368fa54179 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:39.141213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b6cdd-52f7-4d30-99ac-14368fa54179 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:39.185296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8999a1c-495c-46cf-a7a9-8439d812b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:39.186414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999a1c-495c-46cf-a7a9-8439d812b34b None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:39.186739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999a1c-495c-46cf-a7a9-8439d812b34b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:39.187017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999a1c-495c-46cf-a7a9-8439d812b34b None admin] PATH_INFO: `/v3/projects/84c0817ddb0a43df8486657cbfa701e7/users/861a1fbec79a4083b76758d7ed5ce36d/roles/3b586edbe9c24d7288ee1a8e48781662` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:39.189258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8999a1c-495c-46cf-a7a9-8439d812b34b None admin] RBAC: Authorizing `identity:create_grant(project_id=84c0817ddb0a43df8486657cbfa701e7, user_id=861a1fbec79a4083b76758d7ed5ce36d, role_id=3b586edbe9c24d7288ee1a8e48781662)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:39.191062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8999a1c-495c-46cf-a7a9-8439d812b34b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:39.271076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 549/1123] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:51:39 2022] PUT /identity/v3/projects/84c0817ddb0a43df8486657cbfa701e7/users/861a1fbec79a4083b76758d7ed5ce36d/roles/3b586edbe9c24d7288ee1a8e48781662 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:51:41.464813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9350f-f07e-4152-8064-cdd9fcc00577 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:41.465347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9350f-f07e-4152-8064-cdd9fcc00577 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:41.465347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9350f-f07e-4152-8064-cdd9fcc00577 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:41.466679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 575/1124] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:41.472602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c08f-644e-4873-90cf-d92d05638d81 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:41.473003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c08f-644e-4873-90cf-d92d05638d81 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:41.473151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c08f-644e-4873-90cf-d92d05638d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:41.485335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:41.492386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-34d7c08f-644e-4873-90cf-d92d05638d81 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:41.493605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-34d7c08f-644e-4873-90cf-d92d05638d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:41.559745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 550/1125] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:41.835865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9350f-f07e-4152-8064-cdd9fcc00577 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:41.872090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:41.941186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9350f-f07e-4152-8064-cdd9fcc00577 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:41.976969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4bff-6e78-4a3a-a714-99555960086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:41.977581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4bff-6e78-4a3a-a714-99555960086c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:41.977861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4bff-6e78-4a3a-a714-99555960086c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:41.978131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4bff-6e78-4a3a-a714-99555960086c None admin] PATH_INFO: `/v3/roles/3b586edbe9c24d7288ee1a8e48781662` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:41.979519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4bff-6e78-4a3a-a714-99555960086c None admin] RBAC: Authorizing `identity:get_role(role_id=3b586edbe9c24d7288ee1a8e48781662)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:41.980924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4bff-6e78-4a3a-a714-99555960086c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:41.982242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 576/1126] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:41 2022] GET /identity/v3/roles/3b586edbe9c24d7288ee1a8e48781662 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:41.988185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c08f-644e-4873-90cf-d92d05638d81 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:42.086048 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c08f-644e-4873-90cf-d92d05638d81 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:42.118998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0a303-9422-42ea-8c01-0ab6789f2dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:42.119622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a303-9422-42ea-8c01-0ab6789f2dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:42.119901 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a303-9422-42ea-8c01-0ab6789f2dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:42.120175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a303-9422-42ea-8c01-0ab6789f2dd2 None admin] PATH_INFO: `/v3/users/861a1fbec79a4083b76758d7ed5ce36d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:42.121321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0a303-9422-42ea-8c01-0ab6789f2dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=861a1fbec79a4083b76758d7ed5ce36d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:42.122745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0a303-9422-42ea-8c01-0ab6789f2dd2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:42.124319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 551/1127] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:41 2022] GET /identity/v3/users/861a1fbec79a4083b76758d7ed5ce36d => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:42.131030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4bff-6e78-4a3a-a714-99555960086c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:42.232620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4bff-6e78-4a3a-a714-99555960086c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:42.234966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:42.267062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5549f7-c977-4f5d-bc07-58fcc0d10b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:42.268199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5549f7-c977-4f5d-bc07-58fcc0d10b33 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:42.268628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5549f7-c977-4f5d-bc07-58fcc0d10b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:42.269138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5549f7-c977-4f5d-bc07-58fcc0d10b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:42.339842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5549f7-c977-4f5d-bc07-58fcc0d10b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:42.341239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5549f7-c977-4f5d-bc07-58fcc0d10b33 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:42.438463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 577/1128] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:42.445380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0a303-9422-42ea-8c01-0ab6789f2dd2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:42.449152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:42.543982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0a303-9422-42ea-8c01-0ab6789f2dd2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:42.583539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acf4c7-a895-4cb6-b90e-89e7b957e9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:42.584195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acf4c7-a895-4cb6-b90e-89e7b957e9df None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:42.584500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acf4c7-a895-4cb6-b90e-89e7b957e9df None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:42.584816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acf4c7-a895-4cb6-b90e-89e7b957e9df None admin] PATH_INFO: `/v3/projects/84c0817ddb0a43df8486657cbfa701e7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:42.585976 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acf4c7-a895-4cb6-b90e-89e7b957e9df None admin] RBAC: Authorizing `identity:get_project(project_id=84c0817ddb0a43df8486657cbfa701e7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:42.587746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acf4c7-a895-4cb6-b90e-89e7b957e9df None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:42.589444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 552/1129] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:42 2022] GET /identity/v3/projects/84c0817ddb0a43df8486657cbfa701e7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:42.595940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5549f7-c977-4f5d-bc07-58fcc0d10b33 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:42.599009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:42.695962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5549f7-c977-4f5d-bc07-58fcc0d10b33 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:42.729358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a9171-e33e-43fa-8e24-8f0e5b31ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:42.729950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9171-e33e-43fa-8e24-8f0e5b31ab29 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:42.730233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9171-e33e-43fa-8e24-8f0e5b31ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:42.730507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9171-e33e-43fa-8e24-8f0e5b31ab29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:42.731230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a9171-e33e-43fa-8e24-8f0e5b31ab29 None admin] RBAC: Adding query filter params (role.id=3b586edbe9c24d7288ee1a8e48781662, scope.project.id=84c0817ddb0a43df8486657cbfa701e7, user.id=861a1fbec79a4083b76758d7ed5ce36d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:42.731539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a9171-e33e-43fa-8e24-8f0e5b31ab29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:42.732998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a9171-e33e-43fa-8e24-8f0e5b31ab29 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:42.739331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 578/1130] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:42 2022] GET /identity/v3/role_assignments?user.id=861a1fbec79a4083b76758d7ed5ce36d&scope.project.id=84c0817ddb0a43df8486657cbfa701e7&role.id=3b586edbe9c24d7288ee1a8e48781662 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:44.926018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7add058-22c4-4e5c-b3e8-065761266496 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:44.926571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7add058-22c4-4e5c-b3e8-065761266496 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:44.926571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7add058-22c4-4e5c-b3e8-065761266496 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:44.927889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 553/1131] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:44.933072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b115-7604-46f6-b956-3c51a02f6cdc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:44.933457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b115-7604-46f6-b956-3c51a02f6cdc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:44.933630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b115-7604-46f6-b956-3c51a02f6cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:44.951607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bab9b115-7604-46f6-b956-3c51a02f6cdc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:44.952863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bab9b115-7604-46f6-b956-3c51a02f6cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:45.013965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:45.020050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 579/1132] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:45.290737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7add058-22c4-4e5c-b3e8-065761266496 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:45.361763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:45.392255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7add058-22c4-4e5c-b3e8-065761266496 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:45.426241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1181a6f-d3c1-4c35-9ba3-3ce5b692682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:45.426860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181a6f-d3c1-4c35-9ba3-3ce5b692682f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:45.427144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181a6f-d3c1-4c35-9ba3-3ce5b692682f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:45.427420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181a6f-d3c1-4c35-9ba3-3ce5b692682f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:45.428559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1181a6f-d3c1-4c35-9ba3-3ce5b692682f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:45.430071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1181a6f-d3c1-4c35-9ba3-3ce5b692682f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:45.431606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 554/1133] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:45.437569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b115-7604-46f6-b956-3c51a02f6cdc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:45.535926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b115-7604-46f6-b956-3c51a02f6cdc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:45.570243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffe626-2529-4abb-8a87-39b5e07cc7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:45.570868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffe626-2529-4abb-8a87-39b5e07cc7c1 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:45.571152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffe626-2529-4abb-8a87-39b5e07cc7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:45.571429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffe626-2529-4abb-8a87-39b5e07cc7c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:45.572081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffe626-2529-4abb-8a87-39b5e07cc7c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:45.573543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffe626-2529-4abb-8a87-39b5e07cc7c1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:45.669730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 580/1134] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:51:45 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:47.901147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe4742-cfca-4910-a396-868b755d5a02 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:47.901667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe4742-cfca-4910-a396-868b755d5a02 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:47.901754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe4742-cfca-4910-a396-868b755d5a02 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:47.903036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 555/1135] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:47.908430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3242-5ba2-48e9-93c0-e23fc396c6d8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:47.908914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3242-5ba2-48e9-93c0-e23fc396c6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:47.909007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd3242-5ba2-48e9-93c0-e23fc396c6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:47.927720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5fcd3242-5ba2-48e9-93c0-e23fc396c6d8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:47.928933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5fcd3242-5ba2-48e9-93c0-e23fc396c6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:47.975483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:47.995901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 581/1136] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:48.266127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe4742-cfca-4910-a396-868b755d5a02 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:48.372421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe4742-cfca-4910-a396-868b755d5a02 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:48.406308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062f70c-1396-4dc0-8c7c-ea7298332bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:48.406932 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062f70c-1396-4dc0-8c7c-ea7298332bbe None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:48.407213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062f70c-1396-4dc0-8c7c-ea7298332bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:48.407486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062f70c-1396-4dc0-8c7c-ea7298332bbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:48.408616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062f70c-1396-4dc0-8c7c-ea7298332bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:48.410116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062f70c-1396-4dc0-8c7c-ea7298332bbe None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:48.411717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 556/1137] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:51:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:48.417524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd3242-5ba2-48e9-93c0-e23fc396c6d8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:48.516316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd3242-5ba2-48e9-93c0-e23fc396c6d8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:48.550538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e406a-1694-477c-9666-edb024c49873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:48.551140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e406a-1694-477c-9666-edb024c49873 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:48.551417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e406a-1694-477c-9666-edb024c49873 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:48.551688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e406a-1694-477c-9666-edb024c49873 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:48.552343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e406a-1694-477c-9666-edb024c49873 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:48.553885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e406a-1694-477c-9666-edb024c49873 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:48.669081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 582/1138] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:51:48 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:50.882500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a49aea-28b7-4ec6-a9a3-c3add2a04241 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:50.883027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a49aea-28b7-4ec6-a9a3-c3add2a04241 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:50.883116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a49aea-28b7-4ec6-a9a3-c3add2a04241 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:50.884421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 557/1139] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:50.889831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3816-b43a-431f-88de-a8c9efb49bad None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:50.890253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3816-b43a-431f-88de-a8c9efb49bad None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:50.890385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3816-b43a-431f-88de-a8c9efb49bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:50.912386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c77a3816-b43a-431f-88de-a8c9efb49bad None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:50.913613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c77a3816-b43a-431f-88de-a8c9efb49bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:50.948404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:50.990188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 583/1140] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:51.265641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a49aea-28b7-4ec6-a9a3-c3add2a04241 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:51.277168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:51.367464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a49aea-28b7-4ec6-a9a3-c3add2a04241 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:51.400347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88972-31d5-43a1-a6f0-cc44ca295de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:51.401001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88972-31d5-43a1-a6f0-cc44ca295de9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:51.401285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88972-31d5-43a1-a6f0-cc44ca295de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:51.401557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88972-31d5-43a1-a6f0-cc44ca295de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:51.412641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c88972-31d5-43a1-a6f0-cc44ca295de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-85c88972-31d5-43a1-a6f0-cc44ca295de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:51.417437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:51.418513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:51.419382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 558/1141] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:51.424691 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a3816-b43a-431f-88de-a8c9efb49bad None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:51.523139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a3816-b43a-431f-88de-a8c9efb49bad None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:51.557017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:51.564701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:51.564701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:51.564701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:51.564701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:51.564701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:51.564701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:51.568382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 584/1142] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:51.575240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88972-31d5-43a1-a6f0-cc44ca295de9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:51.642071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:51.675619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88972-31d5-43a1-a6f0-cc44ca295de9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:51.709873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084b66-4ea6-4048-a31d-72078b115610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:51.710494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084b66-4ea6-4048-a31d-72078b115610 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:51.710776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084b66-4ea6-4048-a31d-72078b115610 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:51.711054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084b66-4ea6-4048-a31d-72078b115610 None admin] PATH_INFO: `/v3/users/6ba532bd6fe743df85e19c41f844fc21` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:51.725180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084b66-4ea6-4048-a31d-72078b115610 None admin] RBAC: Authorizing `identity:get_user(user_id=6ba532bd6fe743df85e19c41f844fc21)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:51.726613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084b66-4ea6-4048-a31d-72078b115610 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:51.728227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 559/1143] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:51 2022] GET /identity/v3/users/6ba532bd6fe743df85e19c41f844fc21 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:51.734224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:51.766645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:51.840540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa33268-96b3-45ac-8697-710429ece693 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:51.873267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bafaa4-0458-4a79-8831-bd7c0c285ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:51.873867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bafaa4-0458-4a79-8831-bd7c0c285ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:51.874146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bafaa4-0458-4a79-8831-bd7c0c285ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:51.874418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bafaa4-0458-4a79-8831-bd7c0c285ca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:51.941143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bafaa4-0458-4a79-8831-bd7c0c285ca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:51.942594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bafaa4-0458-4a79-8831-bd7c0c285ca5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:51.974747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:52.045604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 585/1144] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:52.052113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084b66-4ea6-4048-a31d-72078b115610 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:52.150107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084b66-4ea6-4048-a31d-72078b115610 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:52.175786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:52.184149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec71ce-db1b-47de-ae3a-2f7bfc9e0ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:52.184814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec71ce-db1b-47de-ae3a-2f7bfc9e0ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:52.185096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec71ce-db1b-47de-ae3a-2f7bfc9e0ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:52.185373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec71ce-db1b-47de-ae3a-2f7bfc9e0ff3 None admin] PATH_INFO: `/v3/projects/d5a64daacc9f4c868af9caed1d367fc6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:52.186492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec71ce-db1b-47de-ae3a-2f7bfc9e0ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=d5a64daacc9f4c868af9caed1d367fc6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:52.187916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec71ce-db1b-47de-ae3a-2f7bfc9e0ff3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:52.189569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 560/1145] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:52 2022] GET /identity/v3/projects/d5a64daacc9f4c868af9caed1d367fc6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:52.196188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bafaa4-0458-4a79-8831-bd7c0c285ca5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:52.295267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bafaa4-0458-4a79-8831-bd7c0c285ca5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:52.321559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:52.329227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dada7c-a51d-4263-8808-5b17651cf46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:52.333124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dada7c-a51d-4263-8808-5b17651cf46b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:52.333124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dada7c-a51d-4263-8808-5b17651cf46b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:52.333124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dada7c-a51d-4263-8808-5b17651cf46b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:52.333124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dada7c-a51d-4263-8808-5b17651cf46b None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=d5a64daacc9f4c868af9caed1d367fc6, user.id=6ba532bd6fe743df85e19c41f844fc21) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:52.333124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dada7c-a51d-4263-8808-5b17651cf46b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:52.333564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dada7c-a51d-4263-8808-5b17651cf46b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:52.339012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 586/1146] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:52 2022] GET /identity/v3/role_assignments?user.id=6ba532bd6fe743df85e19c41f844fc21&scope.project.id=d5a64daacc9f4c868af9caed1d367fc6&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:54.506799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b8cc-4d01-43e6-bb0c-63b46a2bd007 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:54.507365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b8cc-4d01-43e6-bb0c-63b46a2bd007 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:54.507365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b8cc-4d01-43e6-bb0c-63b46a2bd007 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:54.508697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 561/1147] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:54.513948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d577a-97c8-4555-a37f-d3d960b48706 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:54.514354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d577a-97c8-4555-a37f-d3d960b48706 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:54.514498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d577a-97c8-4555-a37f-d3d960b48706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:54.533319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f88d577a-97c8-4555-a37f-d3d960b48706 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:54.535456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f88d577a-97c8-4555-a37f-d3d960b48706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:54.602736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 587/1148] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:54.886907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7b8cc-4d01-43e6-bb0c-63b46a2bd007 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:54.987706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7b8cc-4d01-43e6-bb0c-63b46a2bd007 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:55.021430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a6205-96f0-40fe-bec8-ed9fc8b314fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:55.022063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6205-96f0-40fe-bec8-ed9fc8b314fa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:55.022345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6205-96f0-40fe-bec8-ed9fc8b314fa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:55.022621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a6205-96f0-40fe-bec8-ed9fc8b314fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:55.032854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a6205-96f0-40fe-bec8-ed9fc8b314fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8b8a6205-96f0-40fe-bec8-ed9fc8b314fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:55.038169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:55.039254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:51:55.040290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 562/1149] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:55.045437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d577a-97c8-4555-a37f-d3d960b48706 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:55.144051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d577a-97c8-4555-a37f-d3d960b48706 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:55.166638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:55.178239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:55.178847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:55.179129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:55.179455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:55.180115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:55.180417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:55.181887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:55.189961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 588/1150] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:55.195962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a6205-96f0-40fe-bec8-ed9fc8b314fa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:55.252797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:55.297135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a6205-96f0-40fe-bec8-ed9fc8b314fa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:55.330197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640634f-117c-4d28-a8da-c15dde12d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:55.331449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640634f-117c-4d28-a8da-c15dde12d252 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:55.331764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640634f-117c-4d28-a8da-c15dde12d252 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:55.332042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640634f-117c-4d28-a8da-c15dde12d252 None admin] PATH_INFO: `/v3/users/6ba532bd6fe743df85e19c41f844fc21` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:55.333196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640634f-117c-4d28-a8da-c15dde12d252 None admin] RBAC: Authorizing `identity:get_user(user_id=6ba532bd6fe743df85e19c41f844fc21)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:55.334618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640634f-117c-4d28-a8da-c15dde12d252 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:55.336188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 563/1151] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:55 2022] GET /identity/v3/users/6ba532bd6fe743df85e19c41f844fc21 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:55.342390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:55.440344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1509d0-d763-4342-b8f8-ff8475cb901c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:55.474618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba0025-79e3-4b68-b145-9936770fc13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:55.475238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba0025-79e3-4b68-b145-9936770fc13c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:55.475524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba0025-79e3-4b68-b145-9936770fc13c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:55.475796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba0025-79e3-4b68-b145-9936770fc13c None admin] PATH_INFO: `/v3/projects/d5a64daacc9f4c868af9caed1d367fc6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:55.476936 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba0025-79e3-4b68-b145-9936770fc13c None admin] RBAC: Authorizing `identity:get_project(project_id=d5a64daacc9f4c868af9caed1d367fc6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:55.478361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba0025-79e3-4b68-b145-9936770fc13c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:55.479989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 589/1152] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:55 2022] GET /identity/v3/projects/d5a64daacc9f4c868af9caed1d367fc6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:55.485969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640634f-117c-4d28-a8da-c15dde12d252 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:55.582649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640634f-117c-4d28-a8da-c15dde12d252 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:55.605913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:55.617377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309aef-0684-466c-b1e0-32e94a690d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:55.618037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309aef-0684-466c-b1e0-32e94a690d84 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:55.618319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309aef-0684-466c-b1e0-32e94a690d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:55.621098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309aef-0684-466c-b1e0-32e94a690d84 None admin] PATH_INFO: `/v3/projects/d5a64daacc9f4c868af9caed1d367fc6/users/6ba532bd6fe743df85e19c41f844fc21/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:55.621098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f309aef-0684-466c-b1e0-32e94a690d84 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a64daacc9f4c868af9caed1d367fc6, user_id=6ba532bd6fe743df85e19c41f844fc21, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:55.621985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f309aef-0684-466c-b1e0-32e94a690d84 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:55.760593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 564/1153] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:51:55 2022] PUT /identity/v3/projects/d5a64daacc9f4c868af9caed1d367fc6/users/6ba532bd6fe743df85e19c41f844fc21/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:51:57.942950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f8ea-3e69-405c-aad5-d368a426c493 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:57.943529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f8ea-3e69-405c-aad5-d368a426c493 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:57.943529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f8ea-3e69-405c-aad5-d368a426c493 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:57.944863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 590/1154] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:57.950116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78b981-1f88-42d4-ae51-11861553e29f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:57.950544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78b981-1f88-42d4-ae51-11861553e29f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:57.950647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78b981-1f88-42d4-ae51-11861553e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:57.969286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2a78b981-1f88-42d4-ae51-11861553e29f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:57.970462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2a78b981-1f88-42d4-ae51-11861553e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:58.035634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 565/1155] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:51:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:51:58.305868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f8ea-3e69-405c-aad5-d368a426c493 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:58.360225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:58.409702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f8ea-3e69-405c-aad5-d368a426c493 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:58.443654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d9cd-3d7f-44b5-8986-000eefa12196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:58.444286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d9cd-3d7f-44b5-8986-000eefa12196 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:58.444596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d9cd-3d7f-44b5-8986-000eefa12196 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:58.444875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d9cd-3d7f-44b5-8986-000eefa12196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:58.455255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57d9cd-3d7f-44b5-8986-000eefa12196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ec57d9cd-3d7f-44b5-8986-000eefa12196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:51:58.460096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:51:58.465299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:51:58.466505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 591/1156] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:51:58.467562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78b981-1f88-42d4-ae51-11861553e29f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:58.571078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78b981-1f88-42d4-ae51-11861553e29f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:58.584240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:58.605611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:58.607580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:58.607580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:58.607580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:58.607580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:58.607917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:58.609087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:58.617904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 566/1157] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:58.623953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d9cd-3d7f-44b5-8986-000eefa12196 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:58.724640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d9cd-3d7f-44b5-8986-000eefa12196 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:58.737933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:58.758424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770b54a-6ca8-46e1-b628-c08121053d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:58.759054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b54a-6ca8-46e1-b628-c08121053d4a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:58.759337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b54a-6ca8-46e1-b628-c08121053d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:58.759617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b54a-6ca8-46e1-b628-c08121053d4a None admin] PATH_INFO: `/v3/users/6ba532bd6fe743df85e19c41f844fc21` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:58.760805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770b54a-6ca8-46e1-b628-c08121053d4a None admin] RBAC: Authorizing `identity:get_user(user_id=6ba532bd6fe743df85e19c41f844fc21)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:58.762241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770b54a-6ca8-46e1-b628-c08121053d4a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:58.763823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 592/1158] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:51:58 2022] GET /identity/v3/users/6ba532bd6fe743df85e19c41f844fc21 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:58.770249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:58.871244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c9e1-ce2c-463b-b02a-d9123ade960f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:58.905123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9cd4d-08bf-403d-b90b-916ea3cd7496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:58.905715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cd4d-08bf-403d-b90b-916ea3cd7496 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:58.905995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cd4d-08bf-403d-b90b-916ea3cd7496 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:58.906268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cd4d-08bf-403d-b90b-916ea3cd7496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:58.947833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:58.973223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9cd4d-08bf-403d-b90b-916ea3cd7496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:58.974664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9cd4d-08bf-403d-b90b-916ea3cd7496 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:59.073394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 567/1159] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:51:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:51:59.079502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770b54a-6ca8-46e1-b628-c08121053d4a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:59.177849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770b54a-6ca8-46e1-b628-c08121053d4a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:59.210290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd06af-f4b6-4bf6-a36d-7ff18aa6f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:59.210913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd06af-f4b6-4bf6-a36d-7ff18aa6f423 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:59.211189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd06af-f4b6-4bf6-a36d-7ff18aa6f423 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:59.211460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd06af-f4b6-4bf6-a36d-7ff18aa6f423 None admin] PATH_INFO: `/v3/projects/d5a64daacc9f4c868af9caed1d367fc6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:59.212834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd06af-f4b6-4bf6-a36d-7ff18aa6f423 None admin] RBAC: Authorizing `identity:get_project(project_id=d5a64daacc9f4c868af9caed1d367fc6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:59.214256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd06af-f4b6-4bf6-a36d-7ff18aa6f423 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:59.215879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 593/1160] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:51:59 2022] GET /identity/v3/projects/d5a64daacc9f4c868af9caed1d367fc6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:59.222990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9cd4d-08bf-403d-b90b-916ea3cd7496 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:59.296121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:59.323607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9cd4d-08bf-403d-b90b-916ea3cd7496 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:59.357970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fce783-7c96-4443-9883-26c1445b25e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:59.358570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce783-7c96-4443-9883-26c1445b25e1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:59.358863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce783-7c96-4443-9883-26c1445b25e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:59.359132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce783-7c96-4443-9883-26c1445b25e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:59.359842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fce783-7c96-4443-9883-26c1445b25e1 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=d5a64daacc9f4c868af9caed1d367fc6, user.id=6ba532bd6fe743df85e19c41f844fc21) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:59.360147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fce783-7c96-4443-9883-26c1445b25e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:59.361599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fce783-7c96-4443-9883-26c1445b25e1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:59.367563 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 568/1161] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:51:59 2022] GET /identity/v3/role_assignments?user.id=6ba532bd6fe743df85e19c41f844fc21&scope.project.id=d5a64daacc9f4c868af9caed1d367fc6&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:01.622330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e3a48-26e7-41ed-a93b-ccbeeaf41e1c None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:01.622905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e3a48-26e7-41ed-a93b-ccbeeaf41e1c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:01.622905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e3a48-26e7-41ed-a93b-ccbeeaf41e1c None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:01.624280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 594/1162] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:52:01.630201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2a8ca-891e-4e60-a945-858f0e9f143f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:01.630618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2a8ca-891e-4e60-a945-858f0e9f143f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:01.630763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2a8ca-891e-4e60-a945-858f0e9f143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:01.649637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-abf2a8ca-891e-4e60-a945-858f0e9f143f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:52:01.650835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-abf2a8ca-891e-4e60-a945-858f0e9f143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:52:01.717274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 569/1163] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:52:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:52:01.995503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e3a48-26e7-41ed-a93b-ccbeeaf41e1c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:02.045193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:02.098909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e3a48-26e7-41ed-a93b-ccbeeaf41e1c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:02.135056 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466f069-93bc-4c91-8101-94565a9dd1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:02.135659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466f069-93bc-4c91-8101-94565a9dd1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:02.135941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466f069-93bc-4c91-8101-94565a9dd1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:02.136213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466f069-93bc-4c91-8101-94565a9dd1a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:02.203996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466f069-93bc-4c91-8101-94565a9dd1a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:02.205490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466f069-93bc-4c91-8101-94565a9dd1a0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:02.252561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:02.304876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 595/1164] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:52:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:52:02.310835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2a8ca-891e-4e60-a945-858f0e9f143f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:02.378371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:02.412825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2a8ca-891e-4e60-a945-858f0e9f143f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:02.449351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ef201-356f-4144-9f86-f60c2ff89aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:02.449981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ef201-356f-4144-9f86-f60c2ff89aeb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:02.450261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ef201-356f-4144-9f86-f60c2ff89aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:02.450531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ef201-356f-4144-9f86-f60c2ff89aeb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:02.457777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ef201-356f-4144-9f86-f60c2ff89aeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:02.459196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ef201-356f-4144-9f86-f60c2ff89aeb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-836ef201-356f-4144-9f86-f60c2ff89aeb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:52:02.471984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:52:02.473326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:52:02.474396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 570/1165] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:52:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:52:02.479700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466f069-93bc-4c91-8101-94565a9dd1a0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:02.581363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466f069-93bc-4c91-8101-94565a9dd1a0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:02.616006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34fd4a-fe3d-4363-b95a-9252b8242ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:02.616666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34fd4a-fe3d-4363-b95a-9252b8242ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:02.616945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34fd4a-fe3d-4363-b95a-9252b8242ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:02.617216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34fd4a-fe3d-4363-b95a-9252b8242ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:02.617857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34fd4a-fe3d-4363-b95a-9252b8242ed9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:52:02.618156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34fd4a-fe3d-4363-b95a-9252b8242ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:02.619511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34fd4a-fe3d-4363-b95a-9252b8242ed9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:02.626594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 596/1166] 10.222.0.75 () {56 vars in 1115 bytes} [Mon Sep 19 14:52:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:04.796176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d8b7c-703a-4202-9fe9-f76d4e6dccf4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:04.796742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d8b7c-703a-4202-9fe9-f76d4e6dccf4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:04.796836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d8b7c-703a-4202-9fe9-f76d4e6dccf4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:04.798150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 571/1167] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:52:04.803664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bab1e7-9cd1-42c3-9c61-9e355efc2760 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:04.804080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bab1e7-9cd1-42c3-9c61-9e355efc2760 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:04.804220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bab1e7-9cd1-42c3-9c61-9e355efc2760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:04.823652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-27bab1e7-9cd1-42c3-9c61-9e355efc2760 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:52:04.825225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-27bab1e7-9cd1-42c3-9c61-9e355efc2760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:52:04.834351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:04.899506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 597/1168] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:52:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:52:05.175051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d8b7c-703a-4202-9fe9-f76d4e6dccf4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:05.276839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d8b7c-703a-4202-9fe9-f76d4e6dccf4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:05.302242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:05.309662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab0d7-7552-46b8-aa21-81766faa3c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:05.310265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab0d7-7552-46b8-aa21-81766faa3c30 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:05.310548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab0d7-7552-46b8-aa21-81766faa3c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:05.310827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab0d7-7552-46b8-aa21-81766faa3c30 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:05.311489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ab0d7-7552-46b8-aa21-81766faa3c30 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:05.312873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ab0d7-7552-46b8-aa21-81766faa3c30 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:05.388670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 572/1169] 10.222.0.75 () {60 vars in 1138 bytes} [Mon Sep 19 14:52:05 2022] POST /identity/v3/domains => generated 267 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:52:07.608550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1564aa9-5ccd-45d3-9cca-97c18e85f076 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:07.609137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1564aa9-5ccd-45d3-9cca-97c18e85f076 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:07.609137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1564aa9-5ccd-45d3-9cca-97c18e85f076 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:07.610453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 598/1170] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:52:07.616460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17574f11-7d94-4b9b-aef7-9bb0e23b2494 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:07.616857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17574f11-7d94-4b9b-aef7-9bb0e23b2494 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:07.617048 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17574f11-7d94-4b9b-aef7-9bb0e23b2494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:07.635571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-17574f11-7d94-4b9b-aef7-9bb0e23b2494 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:52:07.636805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-17574f11-7d94-4b9b-aef7-9bb0e23b2494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:52:07.710099 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 573/1171] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:52:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:52:07.985437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1564aa9-5ccd-45d3-9cca-97c18e85f076 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:08.086500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1564aa9-5ccd-45d3-9cca-97c18e85f076 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:08.120697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67aafa-a8ff-42a6-b2b2-627cf3f055fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:08.121318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67aafa-a8ff-42a6-b2b2-627cf3f055fa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:08.121604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67aafa-a8ff-42a6-b2b2-627cf3f055fa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:08.121880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67aafa-a8ff-42a6-b2b2-627cf3f055fa None admin] PATH_INFO: `/v3/domains/932cb081bbfa41c6b8701d4eaf24a28a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:08.132376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67aafa-a8ff-42a6-b2b2-627cf3f055fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=932cb081bbfa41c6b8701d4eaf24a28a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:08.133839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67aafa-a8ff-42a6-b2b2-627cf3f055fa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:08.135454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 599/1172] 10.222.0.75 () {56 vars in 1183 bytes} [Mon Sep 19 14:52:07 2022] GET /identity/v3/domains/932cb081bbfa41c6b8701d4eaf24a28a => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:08.141446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17574f11-7d94-4b9b-aef7-9bb0e23b2494 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:08.239249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17574f11-7d94-4b9b-aef7-9bb0e23b2494 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:08.256834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:08.274021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a99f2-78f2-43d7-8f6f-48a798714d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:08.274627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a99f2-78f2-43d7-8f6f-48a798714d4f None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:08.274910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a99f2-78f2-43d7-8f6f-48a798714d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:08.275183 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a99f2-78f2-43d7-8f6f-48a798714d4f None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:08.275823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a99f2-78f2-43d7-8f6f-48a798714d4f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:08.277257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a99f2-78f2-43d7-8f6f-48a798714d4f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:08.360522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 574/1173] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:52:08 2022] POST /identity/v3/projects => generated 361 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:52:10.598650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc31d0-6a10-4bbb-a30e-108842705251 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:10.599223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc31d0-6a10-4bbb-a30e-108842705251 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:10.599223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc31d0-6a10-4bbb-a30e-108842705251 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:10.600580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 600/1174] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:52:10.605938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a8a9-413e-425d-bcfc-7658dcf85bc4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:10.606361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a8a9-413e-425d-bcfc-7658dcf85bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:10.606490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a8a9-413e-425d-bcfc-7658dcf85bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:10.624910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-aa17a8a9-413e-425d-bcfc-7658dcf85bc4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:52:10.626106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aa17a8a9-413e-425d-bcfc-7658dcf85bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:52:10.694756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 575/1175] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:52:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:52:10.975075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc31d0-6a10-4bbb-a30e-108842705251 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:10.977970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:11.078055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc31d0-6a10-4bbb-a30e-108842705251 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:11.112665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a926f5-f757-428f-b347-e7c1a16c4d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:11.113318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a926f5-f757-428f-b347-e7c1a16c4d53 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:11.113602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a926f5-f757-428f-b347-e7c1a16c4d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:11.113877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a926f5-f757-428f-b347-e7c1a16c4d53 None admin] PATH_INFO: `/v3/domains/932cb081bbfa41c6b8701d4eaf24a28a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:11.115021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a926f5-f757-428f-b347-e7c1a16c4d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=932cb081bbfa41c6b8701d4eaf24a28a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:11.116451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a926f5-f757-428f-b347-e7c1a16c4d53 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:11.118054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 601/1176] 10.222.0.75 () {56 vars in 1183 bytes} [Mon Sep 19 14:52:10 2022] GET /identity/v3/domains/932cb081bbfa41c6b8701d4eaf24a28a => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:11.123857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a8a9-413e-425d-bcfc-7658dcf85bc4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:11.218461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:11.221435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a8a9-413e-425d-bcfc-7658dcf85bc4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:11.255615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69067cf-3823-4ff8-abf0-61a2c5a7ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:11.256162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69067cf-3823-4ff8-abf0-61a2c5a7ea89 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:11.256678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69067cf-3823-4ff8-abf0-61a2c5a7ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:11.257319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69067cf-3823-4ff8-abf0-61a2c5a7ea89 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:11.258030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69067cf-3823-4ff8-abf0-61a2c5a7ea89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:11.259465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69067cf-3823-4ff8-abf0-61a2c5a7ea89 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:11.359151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 576/1177] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:52:11 2022] POST /identity/v3/users => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:52:13.617918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f502-f2b0-4472-ace9-f13919a41f02 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:13.618453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f502-f2b0-4472-ace9-f13919a41f02 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:13.618453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f502-f2b0-4472-ace9-f13919a41f02 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:13.619783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 602/1178] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:52:13.625173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904be2e6-480f-4a2f-b4e1-4b01ab27c20f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:13.625608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904be2e6-480f-4a2f-b4e1-4b01ab27c20f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:13.625716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904be2e6-480f-4a2f-b4e1-4b01ab27c20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:13.645073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-904be2e6-480f-4a2f-b4e1-4b01ab27c20f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:52:13.646256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-904be2e6-480f-4a2f-b4e1-4b01ab27c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:52:13.710948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 577/1179] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:52:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:52:13.982594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f502-f2b0-4472-ace9-f13919a41f02 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:14.058668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:14.091224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f502-f2b0-4472-ace9-f13919a41f02 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:14.124300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de232ba-d076-426c-b65c-566525878597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:14.124942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de232ba-d076-426c-b65c-566525878597 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:14.125219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de232ba-d076-426c-b65c-566525878597 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:14.125487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de232ba-d076-426c-b65c-566525878597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:14.136499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de232ba-d076-426c-b65c-566525878597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9de232ba-d076-426c-b65c-566525878597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:52:14.141236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:52:14.142363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:52:14.143478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 603/1180] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:52:14.148639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904be2e6-480f-4a2f-b4e1-4b01ab27c20f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:14.231573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:14.249668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904be2e6-480f-4a2f-b4e1-4b01ab27c20f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:14.279496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:14.280094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:14.280372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:14.280686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:14.281352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:52:14.281643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:14.282990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:14.292340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 578/1181] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:14.297926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de232ba-d076-426c-b65c-566525878597 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:14.396971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de232ba-d076-426c-b65c-566525878597 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:14.425649 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:14.431615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786fba4-af2b-415b-b5fe-2246495e4f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:14.433850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fba4-af2b-415b-b5fe-2246495e4f9d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:14.433850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fba4-af2b-415b-b5fe-2246495e4f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:14.433850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fba4-af2b-415b-b5fe-2246495e4f9d None admin] PATH_INFO: `/v3/users/8d0fd90554684674bae8d932520122fa` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:14.446495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786fba4-af2b-415b-b5fe-2246495e4f9d None admin] RBAC: Authorizing `identity:get_user(user_id=8d0fd90554684674bae8d932520122fa)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:14.447935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786fba4-af2b-415b-b5fe-2246495e4f9d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:14.449597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 604/1182] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:52:14 2022] GET /identity/v3/users/8d0fd90554684674bae8d932520122fa => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:14.455468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:14.555451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2498-3667-4314-86d3-028d9a9b45a7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:14.587994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240a63f-fd60-44da-a130-c308b95d12be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:14.588632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240a63f-fd60-44da-a130-c308b95d12be None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:14.588917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240a63f-fd60-44da-a130-c308b95d12be None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:14.589193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240a63f-fd60-44da-a130-c308b95d12be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:14.606948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:14.656021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240a63f-fd60-44da-a130-c308b95d12be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:14.657494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240a63f-fd60-44da-a130-c308b95d12be None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:14.759174 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 579/1183] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:52:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:52:14.765068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786fba4-af2b-415b-b5fe-2246495e4f9d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:14.864461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786fba4-af2b-415b-b5fe-2246495e4f9d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:14.898074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fc5e4-3af5-4c19-8947-8e47b138ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:14.898693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fc5e4-3af5-4c19-8947-8e47b138ae62 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:14.898976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fc5e4-3af5-4c19-8947-8e47b138ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:14.899254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fc5e4-3af5-4c19-8947-8e47b138ae62 None admin] PATH_INFO: `/v3/projects/bc40ac1b592549819d2110218f3dd2af` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:14.900369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fc5e4-3af5-4c19-8947-8e47b138ae62 None admin] RBAC: Authorizing `identity:get_project(project_id=bc40ac1b592549819d2110218f3dd2af)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:14.901841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fc5e4-3af5-4c19-8947-8e47b138ae62 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:14.903471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 605/1184] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:52:14 2022] GET /identity/v3/projects/bc40ac1b592549819d2110218f3dd2af => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:14.910578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240a63f-fd60-44da-a130-c308b95d12be None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:14.958497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:15.008921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240a63f-fd60-44da-a130-c308b95d12be None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:15.043787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548634b-bf0a-4e22-9e61-2cf187f9855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:15.044393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548634b-bf0a-4e22-9e61-2cf187f9855f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:15.044696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548634b-bf0a-4e22-9e61-2cf187f9855f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:15.044966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548634b-bf0a-4e22-9e61-2cf187f9855f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:15.045693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548634b-bf0a-4e22-9e61-2cf187f9855f None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=bc40ac1b592549819d2110218f3dd2af, user.id=8d0fd90554684674bae8d932520122fa) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:52:15.045999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548634b-bf0a-4e22-9e61-2cf187f9855f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:15.047417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548634b-bf0a-4e22-9e61-2cf187f9855f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:15.053547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 580/1185] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:52:14 2022] GET /identity/v3/role_assignments?user.id=8d0fd90554684674bae8d932520122fa&scope.project.id=bc40ac1b592549819d2110218f3dd2af&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:17.186139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ed41-9adf-420f-8f96-501e2d5c4d81 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:17.186703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ed41-9adf-420f-8f96-501e2d5c4d81 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:17.186703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ed41-9adf-420f-8f96-501e2d5c4d81 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:17.188014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 606/1186] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:52:17.193691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc4da9-f27d-4c54-8655-70c745bf7645 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:17.194140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc4da9-f27d-4c54-8655-70c745bf7645 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:17.194256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc4da9-f27d-4c54-8655-70c745bf7645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:17.212902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e1dc4da9-f27d-4c54-8655-70c745bf7645 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:52:17.214095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e1dc4da9-f27d-4c54-8655-70c745bf7645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:52:17.279412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 581/1187] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:52:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:52:17.546326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309ed41-9adf-420f-8f96-501e2d5c4d81 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:17.603774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:17.648220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309ed41-9adf-420f-8f96-501e2d5c4d81 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:17.682093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906f62-35b1-41f4-ac34-f6e252202034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:17.682716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906f62-35b1-41f4-ac34-f6e252202034 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:17.682994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906f62-35b1-41f4-ac34-f6e252202034 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:17.683266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906f62-35b1-41f4-ac34-f6e252202034 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:17.693058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6906f62-35b1-41f4-ac34-f6e252202034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b6906f62-35b1-41f4-ac34-f6e252202034 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:52:17.697823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:52:17.698901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:52:17.699801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 607/1188] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:52:17.705638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc4da9-f27d-4c54-8655-70c745bf7645 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:17.748858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:17.804975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc4da9-f27d-4c54-8655-70c745bf7645 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:17.838495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:17.839100 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:17.839384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:17.839660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:17.840316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:52:17.840650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:17.842005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:17.850394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 582/1189] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:52:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:17.856318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906f62-35b1-41f4-ac34-f6e252202034 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:17.963608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906f62-35b1-41f4-ac34-f6e252202034 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:17.981010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:17.998403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad687012-8509-4511-a6b0-38f2e1ef817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:17.999025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad687012-8509-4511-a6b0-38f2e1ef817e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:17.999295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad687012-8509-4511-a6b0-38f2e1ef817e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:17.999563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad687012-8509-4511-a6b0-38f2e1ef817e None admin] PATH_INFO: `/v3/users/8d0fd90554684674bae8d932520122fa` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:18.000728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad687012-8509-4511-a6b0-38f2e1ef817e None admin] RBAC: Authorizing `identity:get_user(user_id=8d0fd90554684674bae8d932520122fa)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:18.003199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad687012-8509-4511-a6b0-38f2e1ef817e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:18.004962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 608/1190] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:52:17 2022] GET /identity/v3/users/8d0fd90554684674bae8d932520122fa => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:18.010827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:18.111303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923227b-e280-4d80-a094-996ecec381ba None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:18.113708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:18.144834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e30dfb-87fb-4cd0-b73a-497177e8e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:18.145465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30dfb-87fb-4cd0-b73a-497177e8e912 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:18.145748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30dfb-87fb-4cd0-b73a-497177e8e912 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:18.146026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30dfb-87fb-4cd0-b73a-497177e8e912 None admin] PATH_INFO: `/v3/projects/bc40ac1b592549819d2110218f3dd2af` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:18.147143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e30dfb-87fb-4cd0-b73a-497177e8e912 None admin] RBAC: Authorizing `identity:get_project(project_id=bc40ac1b592549819d2110218f3dd2af)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:18.148601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e30dfb-87fb-4cd0-b73a-497177e8e912 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:18.150282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 583/1191] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:52:18 2022] GET /identity/v3/projects/bc40ac1b592549819d2110218f3dd2af => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:18.156329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad687012-8509-4511-a6b0-38f2e1ef817e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:18.254438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad687012-8509-4511-a6b0-38f2e1ef817e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:18.288078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4a210-12f7-4eda-9a40-457d018bd23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:18.288754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a210-12f7-4eda-9a40-457d018bd23c None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:18.289043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a210-12f7-4eda-9a40-457d018bd23c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:18.289318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4a210-12f7-4eda-9a40-457d018bd23c None admin] PATH_INFO: `/v3/projects/bc40ac1b592549819d2110218f3dd2af/users/8d0fd90554684674bae8d932520122fa/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:18.291203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4a210-12f7-4eda-9a40-457d018bd23c None admin] RBAC: Authorizing `identity:create_grant(project_id=bc40ac1b592549819d2110218f3dd2af, user_id=8d0fd90554684674bae8d932520122fa, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:18.292662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4a210-12f7-4eda-9a40-457d018bd23c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:18.369946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 609/1192] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:52:18 2022] PUT /identity/v3/projects/bc40ac1b592549819d2110218f3dd2af/users/8d0fd90554684674bae8d932520122fa/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:52:20.560103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d69fc-2df4-4d77-b452-21aad86a05fa None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:20.560669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d69fc-2df4-4d77-b452-21aad86a05fa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:20.560669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d69fc-2df4-4d77-b452-21aad86a05fa None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:20.562084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 584/1193] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:52:20.568150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99743f89-b6f8-4801-8067-f09427802dde None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:20.568571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99743f89-b6f8-4801-8067-f09427802dde None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:20.568745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99743f89-b6f8-4801-8067-f09427802dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:20.587217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-99743f89-b6f8-4801-8067-f09427802dde None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:52:20.588407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-99743f89-b6f8-4801-8067-f09427802dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:52:20.628497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:20.654554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 610/1194] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:52:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:52:20.934705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d69fc-2df4-4d77-b452-21aad86a05fa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:21.035807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d69fc-2df4-4d77-b452-21aad86a05fa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:21.068559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762156fd-a9dc-44b9-9a41-51b077e566e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:21.069178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762156fd-a9dc-44b9-9a41-51b077e566e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:21.069457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762156fd-a9dc-44b9-9a41-51b077e566e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:21.069728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762156fd-a9dc-44b9-9a41-51b077e566e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:21.080744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762156fd-a9dc-44b9-9a41-51b077e566e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-762156fd-a9dc-44b9-9a41-51b077e566e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:52:21.085490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:52:21.086603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:52:21.088115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 585/1195] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:52:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:52:21.092939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99743f89-b6f8-4801-8067-f09427802dde None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:21.192855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99743f89-b6f8-4801-8067-f09427802dde None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:21.227094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:21.227712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:21.227998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:21.228275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:21.229008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:52:21.229282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:21.230666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:21.239363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 611/1196] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:52:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:21.245328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762156fd-a9dc-44b9-9a41-51b077e566e8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:21.277771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:21.350280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762156fd-a9dc-44b9-9a41-51b077e566e8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:21.382397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602e129-d5d1-44f5-9148-7f5c6762dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:21.383023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e129-d5d1-44f5-9148-7f5c6762dd79 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:21.383308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e129-d5d1-44f5-9148-7f5c6762dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:21.383584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e129-d5d1-44f5-9148-7f5c6762dd79 None admin] PATH_INFO: `/v3/users/8d0fd90554684674bae8d932520122fa` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:21.384746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602e129-d5d1-44f5-9148-7f5c6762dd79 None admin] RBAC: Authorizing `identity:get_user(user_id=8d0fd90554684674bae8d932520122fa)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:21.386171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602e129-d5d1-44f5-9148-7f5c6762dd79 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:21.387943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 586/1197] 10.222.0.75 () {56 vars in 1177 bytes} [Mon Sep 19 14:52:21 2022] GET /identity/v3/users/8d0fd90554684674bae8d932520122fa => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:21.394417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:21.430462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:21.496440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905696c-67ff-4759-80ae-16aa8dfddf26 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:21.529354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c5c3-bdbb-4fde-8416-34589076900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:21.529961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c5c3-bdbb-4fde-8416-34589076900c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:21.530248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c5c3-bdbb-4fde-8416-34589076900c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:21.530524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c5c3-bdbb-4fde-8416-34589076900c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:21.597202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2c5c3-bdbb-4fde-8416-34589076900c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:21.598648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2c5c3-bdbb-4fde-8416-34589076900c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:21.634064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:21.698452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 612/1198] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:52:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:52:21.704611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602e129-d5d1-44f5-9148-7f5c6762dd79 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:21.802715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:21.805621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602e129-d5d1-44f5-9148-7f5c6762dd79 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:21.838513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244145c-2a6c-4fa1-92f3-0e167e6e1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:21.839143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244145c-2a6c-4fa1-92f3-0e167e6e1c7a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:21.839424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244145c-2a6c-4fa1-92f3-0e167e6e1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:21.839701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244145c-2a6c-4fa1-92f3-0e167e6e1c7a None admin] PATH_INFO: `/v3/projects/bc40ac1b592549819d2110218f3dd2af` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:21.840843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244145c-2a6c-4fa1-92f3-0e167e6e1c7a None admin] RBAC: Authorizing `identity:get_project(project_id=bc40ac1b592549819d2110218f3dd2af)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:21.842267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244145c-2a6c-4fa1-92f3-0e167e6e1c7a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:21.843904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 587/1199] 10.222.0.75 () {56 vars in 1186 bytes} [Mon Sep 19 14:52:21 2022] GET /identity/v3/projects/bc40ac1b592549819d2110218f3dd2af => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:21.850677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c5c3-bdbb-4fde-8416-34589076900c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:52:21.948214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c5c3-bdbb-4fde-8416-34589076900c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:52:21.984430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144ed39-6493-4741-ab31-51019e8ac032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:52:21.985061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ed39-6493-4741-ab31-51019e8ac032 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:52:21.985342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ed39-6493-4741-ab31-51019e8ac032 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:52:21.985617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144ed39-6493-4741-ab31-51019e8ac032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:52:21.986368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144ed39-6493-4741-ab31-51019e8ac032 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=bc40ac1b592549819d2110218f3dd2af, user.id=8d0fd90554684674bae8d932520122fa) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:52:21.986676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144ed39-6493-4741-ab31-51019e8ac032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:52:21.988104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144ed39-6493-4741-ab31-51019e8ac032 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:52:21.990892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:21.994155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 613/1200] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:52:21 2022] GET /identity/v3/role_assignments?user.id=8d0fd90554684674bae8d932520122fa&scope.project.id=bc40ac1b592549819d2110218f3dd2af&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:52:31.834098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=16 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:44.130061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82b1c4-dc5b-42f9-9022-368779e2380e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:44.130749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82b1c4-dc5b-42f9-9022-368779e2380e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:44.130749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82b1c4-dc5b-42f9-9022-368779e2380e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:44.131938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 588/1201] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:44.137460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0edf7e-f246-412f-9b99-8814145a32f8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:44.138121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0edf7e-f246-412f-9b99-8814145a32f8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:44.138121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0edf7e-f246-412f-9b99-8814145a32f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:44.157304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7d0edf7e-f246-412f-9b99-8814145a32f8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:44.158495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7d0edf7e-f246-412f-9b99-8814145a32f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:44.225752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 614/1202] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:53:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:53:44.500985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82b1c4-dc5b-42f9-9022-368779e2380e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:44.604245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82b1c4-dc5b-42f9-9022-368779e2380e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:44.641371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:44.642018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:44.642315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:44.642566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:44.653597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:44.655643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:53:44.669776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:44.675892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:53:44.678374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:53:44.678374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:44.678374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:53:44.678374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 589/1203] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:44.679310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0edf7e-f246-412f-9b99-8814145a32f8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:44.781783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0edf7e-f246-412f-9b99-8814145a32f8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:44.811927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:44.817695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68fc47-1f29-438e-94ad-fc13ac18f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:44.818309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fc47-1f29-438e-94ad-fc13ac18f23e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:44.818595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fc47-1f29-438e-94ad-fc13ac18f23e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:44.818871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fc47-1f29-438e-94ad-fc13ac18f23e None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:44.819518 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68fc47-1f29-438e-94ad-fc13ac18f23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:44.819824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68fc47-1f29-438e-94ad-fc13ac18f23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:44.821230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68fc47-1f29-438e-94ad-fc13ac18f23e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:44.832962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 615/1204] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:53:44.838985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:44.891779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:44.937838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012e6d-22bc-4c85-b7c0-e9ad25183515 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:44.973501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524b45e-4dea-4bc0-941f-9d5f1734921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:44.974219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b45e-4dea-4bc0-941f-9d5f1734921c None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:44.974497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b45e-4dea-4bc0-941f-9d5f1734921c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:44.974765 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b45e-4dea-4bc0-941f-9d5f1734921c None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:44.975408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524b45e-4dea-4bc0-941f-9d5f1734921c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:44.976869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524b45e-4dea-4bc0-941f-9d5f1734921c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:45.111733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 590/1205] 10.222.0.75 () {60 vars in 1132 bytes} [Mon Sep 19 14:53:44 2022] POST /identity/v3/users => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:53:47.316110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d661-a870-4f13-83c3-89bb3fbf33a4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:47.316738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d661-a870-4f13-83c3-89bb3fbf33a4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:47.316738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d661-a870-4f13-83c3-89bb3fbf33a4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:47.318033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 616/1206] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:47.323320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8db5d-a0a5-4cee-a779-fc87557c590f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:47.323722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8db5d-a0a5-4cee-a779-fc87557c590f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:47.323875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8db5d-a0a5-4cee-a779-fc87557c590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:47.343437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-21f8db5d-a0a5-4cee-a779-fc87557c590f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:47.348279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-21f8db5d-a0a5-4cee-a779-fc87557c590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:47.410537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 591/1207] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:53:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:53:47.682673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d661-a870-4f13-83c3-89bb3fbf33a4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:47.793991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d661-a870-4f13-83c3-89bb3fbf33a4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:47.827898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd5513-a0a1-4116-9a60-832d0b8938bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:47.828540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5513-a0a1-4116-9a60-832d0b8938bc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:47.828887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5513-a0a1-4116-9a60-832d0b8938bc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:47.829236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5513-a0a1-4116-9a60-832d0b8938bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:47.840614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd5513-a0a1-4116-9a60-832d0b8938bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9acd5513-a0a1-4116-9a60-832d0b8938bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:53:47.845648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:47.846871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:47.847732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 617/1208] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:53:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:47.853151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8db5d-a0a5-4cee-a779-fc87557c590f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:47.893186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:47.951492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8db5d-a0a5-4cee-a779-fc87557c590f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:47.985214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:47.985825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:47.986108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:47.986383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:47.987043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:47.987346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:47.988733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:47.996373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 592/1209] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:53:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:48.003470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd5513-a0a1-4116-9a60-832d0b8938bc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:48.053717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:48.103351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd5513-a0a1-4116-9a60-832d0b8938bc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:48.137747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:48.138360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:48.138924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:48.140193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:48.151331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:48.152803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:53:48.167416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:48.169217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:53:48.170689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:53:48.170689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:48.170689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:48.170689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 618/1210] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:48.174672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:48.274319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:48.277322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece71fd1-fd86-4654-8e50-61b90da45e75 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:48.310739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:48.311356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:48.311640 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:48.311917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:48.312599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:48.312905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:48.314272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:48.325816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 593/1211] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:48.332182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:48.440584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa219c4-30d6-43d8-a38b-bdbbb5e1e6e4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:48.442226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:48.475177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:48.475798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:48.476077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:48.476355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:48.484502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:48.486024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:53:48.497162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:48.498313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:48.499806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 619/1212] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:48.506826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:48.602500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887a472-dd11-4407-9c4c-66e48cc8382c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:48.637330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:48.637935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:48.638208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:48.638473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:48.639243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:48.639728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:48.641227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:48.659425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 594/1213] 10.222.0.75 () {56 vars in 1143 bytes} [Mon Sep 19 14:53:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:48.665406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:48.768933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5e6a-42aa-4bba-914c-525d7727336f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:48.812802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc82a-1342-4b30-95fa-89ea337f3a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:48.813409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc82a-1342-4b30-95fa-89ea337f3a45 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:48.813690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc82a-1342-4b30-95fa-89ea337f3a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:48.813962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc82a-1342-4b30-95fa-89ea337f3a45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:48.845149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:48.881670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc82a-1342-4b30-95fa-89ea337f3a45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:48.883165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc82a-1342-4b30-95fa-89ea337f3a45 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:48.985517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 620/1214] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:53:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:53:48.991450 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:49.010459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:49.090073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5a4c2-e353-49f0-a6f3-370b9245ab1c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:49.124060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:49.124846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:49.125124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:49.125394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:49.135428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:49.136932 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:53:49.152625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:49.161080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:53:49.162192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:53:49.162192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:49.162192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:53:49.162192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 595/1215] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:49.162455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc82a-1342-4b30-95fa-89ea337f3a45 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:49.224126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:49.262590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc82a-1342-4b30-95fa-89ea337f3a45 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:49.297881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:49.298522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:49.298804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:49.299089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:49.299726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:49.300028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:49.301421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:49.313062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 621/1216] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:49.318892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:49.391095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:49.421301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb12831-d5e5-43e5-afe7-775612be6740 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:49.458380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:49.458380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:49.458380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:49.458380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:49.463116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:49.464580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:53:49.477847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:49.479073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:53:49.480365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 596/1217] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:49.487607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:49.587065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23171ba-1669-4fa6-b445-cc875405feb4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:49.610944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:49.622728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978cfa3-665f-4a57-b31d-46547ceaf571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:49.623336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978cfa3-665f-4a57-b31d-46547ceaf571 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:49.624265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978cfa3-665f-4a57-b31d-46547ceaf571 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:49.624644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978cfa3-665f-4a57-b31d-46547ceaf571 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:49.625658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978cfa3-665f-4a57-b31d-46547ceaf571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:49.625968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978cfa3-665f-4a57-b31d-46547ceaf571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:49.627408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978cfa3-665f-4a57-b31d-46547ceaf571 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:49.640533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 622/1218] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:49.647289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:49.749278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c105b-35f5-473f-bcab-c65336f99ea7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:49.777714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:49.784125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed015-a9ce-4d80-8a5d-acea8ecac9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:49.786784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed015-a9ce-4d80-8a5d-acea8ecac9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:49.786784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed015-a9ce-4d80-8a5d-acea8ecac9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:49.786784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed015-a9ce-4d80-8a5d-acea8ecac9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:49.786784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ed015-a9ce-4d80-8a5d-acea8ecac9a4 None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=9e921d9249fb49d4ad9c94caa6691a6b) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:49.786784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ed015-a9ce-4d80-8a5d-acea8ecac9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:49.787785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ed015-a9ce-4d80-8a5d-acea8ecac9a4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:49.793495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 597/1219] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:53:49 2022] GET /identity/v3/role_assignments?user.id=9e921d9249fb49d4ad9c94caa6691a6b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:51.950892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7498c0-34a3-4935-ad4d-8d2996be51c5 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:51.951438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7498c0-34a3-4935-ad4d-8d2996be51c5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:51.951438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7498c0-34a3-4935-ad4d-8d2996be51c5 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:51.952851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 623/1220] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:51.957897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb8861-d0bc-49ef-8dac-fadc809ac8e2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:51.958313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb8861-d0bc-49ef-8dac-fadc809ac8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:51.958439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb8861-d0bc-49ef-8dac-fadc809ac8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:51.977806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c7eb8861-d0bc-49ef-8dac-fadc809ac8e2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:51.978976 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c7eb8861-d0bc-49ef-8dac-fadc809ac8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:52.046200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 598/1221] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:53:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:53:52.316610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7498c0-34a3-4935-ad4d-8d2996be51c5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:52.418796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7498c0-34a3-4935-ad4d-8d2996be51c5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:52.454869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a4ffc-6cad-45fb-a2be-2e7f038acf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:52.455546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a4ffc-6cad-45fb-a2be-2e7f038acf5c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:52.455813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a4ffc-6cad-45fb-a2be-2e7f038acf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:52.456088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a4ffc-6cad-45fb-a2be-2e7f038acf5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:52.469334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a4ffc-6cad-45fb-a2be-2e7f038acf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-066a4ffc-6cad-45fb-a2be-2e7f038acf5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:53:52.474148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:52.475242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:52.477592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 624/1222] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:53:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:52.481437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb8861-d0bc-49ef-8dac-fadc809ac8e2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:52.580612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb8861-d0bc-49ef-8dac-fadc809ac8e2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:52.604319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:52.615085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:52.615736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:52.616018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:52.616291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:52.616989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:52.623206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:52.623206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:52.626749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 599/1223] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:53:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:52.632580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a4ffc-6cad-45fb-a2be-2e7f038acf5c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:52.676797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:52.732566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a4ffc-6cad-45fb-a2be-2e7f038acf5c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:52.769109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:52.769738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:52.770022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:52.770288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:52.780962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:52.782414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:53:52.797243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:52.798438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:53:52.799638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:53:52.799638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:52.799638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:52.799638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 625/1224] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:52.804149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:52.904988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ce8a7-12c2-4022-8035-1ba850be8c87 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:52.939158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:52.939763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:52.940045 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:52.940321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:52.940992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:52.941299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:52.942654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:52.955839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 600/1225] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:52.962970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:53.065985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:53.072493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652612-b01b-4347-81d0-b667e44f13a3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:53.106276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:53.106892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:53.107175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:53.107445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:53.116124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:53.117796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:53:53.128711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:53.129724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:53.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 626/1226] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:53.135841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:53.183545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:53.237654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12457db-ff85-4d24-8df2-3017545de33c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:53.271592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:53.272205 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:53.272512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:53.272786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:53.273504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:53.273807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:53.275304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:53.292559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 601/1227] 10.222.0.75 () {56 vars in 1143 bytes} [Mon Sep 19 14:53:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:53.299378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:53.401584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27680c-beb9-4eaf-a0e5-f3473c9f492f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:53.436072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:53.436886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:53.437162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:53.437441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:53.449029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:53.450487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:53:53.465421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:53.466622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:53:53.468436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:53:53.468436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:53.468436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:53.468436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 627/1228] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:53.473301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:53.573506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c322486-6abb-47d6-8e15-2745259b74a8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:53.575897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:53.608024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:53.608729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:53.609009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:53.609280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:53.609911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:53.610212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:53.611618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:53.622614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 602/1229] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:53.628360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:53.637824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:53.728437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f83229-08a6-42c7-843e-1a5a0b38c38d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:53.766837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:53.767466 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:53.767747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:53.768019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:53.774947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:53.776442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:53:53.789558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:53.792948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:53.794084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 628/1230] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:53.796626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:53.897648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8270621-b2df-4135-938d-bb199710a9cf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:53.941120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47872b9-0a02-4c87-a4d8-4dda529c479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:53.941731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47872b9-0a02-4c87-a4d8-4dda529c479a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:53.942011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47872b9-0a02-4c87-a4d8-4dda529c479a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:53.942312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47872b9-0a02-4c87-a4d8-4dda529c479a None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:53.943097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47872b9-0a02-4c87-a4d8-4dda529c479a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:53.943406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47872b9-0a02-4c87-a4d8-4dda529c479a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:53.944845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47872b9-0a02-4c87-a4d8-4dda529c479a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:53.957746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 603/1231] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:53:53.963972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:54.029583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:54.064975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b392-16dc-494d-b761-6c7816b634bb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:54.098450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5096b4e-b1c4-48a5-a936-98b9426d6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:54.099312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5096b4e-b1c4-48a5-a936-98b9426d6a7b None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:54.099636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5096b4e-b1c4-48a5-a936-98b9426d6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:54.100185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5096b4e-b1c4-48a5-a936-98b9426d6a7b None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/9e921d9249fb49d4ad9c94caa6691a6b/roles/d080aeef5e23467ba4a98bd13261f353` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:54.115647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5096b4e-b1c4-48a5-a936-98b9426d6a7b None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=9e921d9249fb49d4ad9c94caa6691a6b, role_id=d080aeef5e23467ba4a98bd13261f353)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:54.117175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5096b4e-b1c4-48a5-a936-98b9426d6a7b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:54.162249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 629/1232] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:53:53 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/9e921d9249fb49d4ad9c94caa6691a6b/roles/d080aeef5e23467ba4a98bd13261f353 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:53:56.338093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c523-6691-4a6e-a123-21948ff065e3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:56.338702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c523-6691-4a6e-a123-21948ff065e3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:56.338702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c523-6691-4a6e-a123-21948ff065e3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:56.340004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 604/1233] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:56.345590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc085562-78a4-4c74-aa06-052d99e7738f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:56.346024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc085562-78a4-4c74-aa06-052d99e7738f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:56.346142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc085562-78a4-4c74-aa06-052d99e7738f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:56.365156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fc085562-78a4-4c74-aa06-052d99e7738f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:56.366348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fc085562-78a4-4c74-aa06-052d99e7738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:56.433520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 630/1234] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:53:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:53:56.705197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c523-6691-4a6e-a123-21948ff065e3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:56.731721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:56.818220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c523-6691-4a6e-a123-21948ff065e3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:56.852756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28702b-b62c-4392-a91c-ab41619ba657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:56.853389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28702b-b62c-4392-a91c-ab41619ba657 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:56.853665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28702b-b62c-4392-a91c-ab41619ba657 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:56.853937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28702b-b62c-4392-a91c-ab41619ba657 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:56.864376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28702b-b62c-4392-a91c-ab41619ba657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-dc28702b-b62c-4392-a91c-ab41619ba657 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:53:56.869610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:56.870843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:53:56.871894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 605/1235] 10.222.0.75 () {56 vars in 1102 bytes} [Mon Sep 19 14:53:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:56.876571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc085562-78a4-4c74-aa06-052d99e7738f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:56.925293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:56.977747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc085562-78a4-4c74-aa06-052d99e7738f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:57.013366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:57.015382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:57.015382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:57.015382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:57.015382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:57.015911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:57.017079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:57.025077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 631/1236] 10.222.0.75 () {56 vars in 1103 bytes} [Mon Sep 19 14:53:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:57.032013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28702b-b62c-4392-a91c-ab41619ba657 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:57.127842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:57.144750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28702b-b62c-4392-a91c-ab41619ba657 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:57.179104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:57.179723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:57.180000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:57.180270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:57.190868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:57.192308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:53:57.207816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:57.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:53:57.210055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:53:57.210055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:57.210055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:53:57.210055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 606/1237] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:57.215105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:57.320966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6182bb-c4ce-420f-8168-85eab9015b47 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:57.330401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:57.355293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:57.355927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:57.356180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:57.356451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:57.357125 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:57.357430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:57.358837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:57.370498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 632/1238] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:57.376423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:57.477741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc33ec-3242-4629-84bf-90897492fa73 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:57.513794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:57.514631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:57.514974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:57.515248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:57.518035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:57.523185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:57.524766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:53:57.537038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:57.542768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:53:57.544062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 607/1239] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:57.544826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:57.646068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd77065-1de1-4bc8-8758-e223988cb184 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:57.681188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:57.681791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:57.682098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:57.682373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:57.683101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:57.683405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:57.684858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:57.702138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 633/1240] 10.222.0.75 () {56 vars in 1143 bytes} [Mon Sep 19 14:53:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:57.708473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:57.810262 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78fc5-6455-4407-a150-05ebf09ac082 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:57.846253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059161ce-2da5-4241-a6b9-e621bd203ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:57.846857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059161ce-2da5-4241-a6b9-e621bd203ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:57.847145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059161ce-2da5-4241-a6b9-e621bd203ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:57.847421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059161ce-2da5-4241-a6b9-e621bd203ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:57.908627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:57.915105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059161ce-2da5-4241-a6b9-e621bd203ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:57.916583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059161ce-2da5-4241-a6b9-e621bd203ce7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:58.017506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 608/1241] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:53:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:53:58.023365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:58.051147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:58.124566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e72b4-4396-4df3-ac99-9ddedb58dbf1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:58.178024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:58.178596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:58.178875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:58.179153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:58.189943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:58.191394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:53:58.206379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:58.207534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:53:58.208621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:53:58.208621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:53:58.208621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:58.208621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 634/1242] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:58.213751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059161ce-2da5-4241-a6b9-e621bd203ce7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:58.306850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:58.312985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059161ce-2da5-4241-a6b9-e621bd203ce7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:58.348700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:58.349262 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:58.349538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:58.349809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:58.350437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:58.350751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:58.352078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:58.363064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 609/1243] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:58.368978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:58.448234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:58.478594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf3efa-d0a3-49f9-99b0-e13a980cf485 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:58.520343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:58.521003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:58.521288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:58.521567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:58.528699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:58.530729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:53:58.542253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:53:58.543317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:53:58.544384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 635/1244] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:53:58.550248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:58.651064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac74ce7-cd42-4f92-bfe5-317ce08a7d61 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:58.684503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac937-76e4-4b64-8076-049482281dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:58.685134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac937-76e4-4b64-8076-049482281dbf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:58.685418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac937-76e4-4b64-8076-049482281dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:58.685697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac937-76e4-4b64-8076-049482281dbf None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:58.686454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac937-76e4-4b64-8076-049482281dbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:58.686758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac937-76e4-4b64-8076-049482281dbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:58.688214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac937-76e4-4b64-8076-049482281dbf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:58.700233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 610/1245] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:58.706964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:58.810194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b420884-f3bf-4a62-bd63-24785e420fdd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:58.846986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63f226-0654-42e4-86df-a0d0795b6575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:58.847598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f226-0654-42e4-86df-a0d0795b6575 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:58.847880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f226-0654-42e4-86df-a0d0795b6575 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:58.848156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f226-0654-42e4-86df-a0d0795b6575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:58.848924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63f226-0654-42e4-86df-a0d0795b6575 None admin] RBAC: Adding query filter params (role.id=d080aeef5e23467ba4a98bd13261f353, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=9e921d9249fb49d4ad9c94caa6691a6b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:53:58.849269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63f226-0654-42e4-86df-a0d0795b6575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:58.850697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63f226-0654-42e4-86df-a0d0795b6575 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:58.856532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 636/1246] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:53:58 2022] GET /identity/v3/role_assignments?user.id=9e921d9249fb49d4ad9c94caa6691a6b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=d080aeef5e23467ba4a98bd13261f353 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:01.100784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708b5a-fc0f-4256-88b3-3eab9195112d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:01.101700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708b5a-fc0f-4256-88b3-3eab9195112d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:01.101700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708b5a-fc0f-4256-88b3-3eab9195112d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:01.103319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 611/1247] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:01.109480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2857b9-415d-4b4a-9109-f7b3c010339e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:01.109922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2857b9-415d-4b4a-9109-f7b3c010339e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:01.110137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2857b9-415d-4b4a-9109-f7b3c010339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:01.116428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:01.129555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ed2857b9-415d-4b4a-9109-f7b3c010339e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:01.130749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ed2857b9-415d-4b4a-9109-f7b3c010339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:01.200362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 637/1248] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:54:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:54:01.496269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1708b5a-fc0f-4256-88b3-3eab9195112d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:01.516119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:01.603365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1708b5a-fc0f-4256-88b3-3eab9195112d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:01.637425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d7fa5-8362-4580-9430-ca55e21b1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:01.638040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7fa5-8362-4580-9430-ca55e21b1552 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:01.638313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7fa5-8362-4580-9430-ca55e21b1552 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:01.638581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7fa5-8362-4580-9430-ca55e21b1552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:01.648569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d7fa5-8362-4580-9430-ca55e21b1552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ea7d7fa5-8362-4580-9430-ca55e21b1552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:54:01.653427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:01.654623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:01.655917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 612/1249] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:54:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:01.660938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2857b9-415d-4b4a-9109-f7b3c010339e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:01.759480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2857b9-415d-4b4a-9109-f7b3c010339e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:01.789312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:01.796190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:01.796190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:01.796190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:01.797186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:01.797918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:01.798265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:01.799673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:01.807777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 638/1250] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:54:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:01.814709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d7fa5-8362-4580-9430-ca55e21b1552 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:01.894964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:01.917307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d7fa5-8362-4580-9430-ca55e21b1552 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:01.951132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:01.951749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:01.952662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:01.952938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:01.962798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:01.964228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:54:01.979830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:01.981057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:54:01.987064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:54:01.987064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:01.987064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:01.987064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 613/1251] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:54:01.987681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:02.088941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fdc96-acaa-42c7-b12c-97fec610c444 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:02.123013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:02.124236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:02.124438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:02.126501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:02.126501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:02.126501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:02.127189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:02.138896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 639/1252] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:02.145327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:02.243292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff1d5-4fd7-4a6b-98d7-885ef4c9b425 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:02.270083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:02.277740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:02.278372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:02.278654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:02.278924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:02.287921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:02.289382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:54:02.300969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:02.302188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:02.303245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 614/1253] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:02.307919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:02.364464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:02.408711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ff2dc-34ac-4e7e-a169-f7a04e5efda5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:02.443036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:02.443659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:02.443941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:02.444216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:02.444997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:02.445302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:02.446765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:02.465081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 640/1254] 10.222.0.75 () {56 vars in 1143 bytes} [Mon Sep 19 14:54:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:02.471827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:02.574928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f337-c937-4014-9e7f-ff525ee4115e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:02.607956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6149-07e0-481a-8a28-e64ec3393ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:02.609110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6149-07e0-481a-8a28-e64ec3393ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:02.609388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6149-07e0-481a-8a28-e64ec3393ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:02.609660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6149-07e0-481a-8a28-e64ec3393ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:02.664103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:02.676701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6149-07e0-481a-8a28-e64ec3393ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:02.678145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6149-07e0-481a-8a28-e64ec3393ee4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:02.775386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 615/1255] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:54:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:54:02.781900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:02.882406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5892f-77da-40ae-b625-64075521edcb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:02.896586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:02.917427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:02.917994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:02.918277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:02.918552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:02.928894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:02.930333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:54:02.944896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:02.946123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:54:02.947204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:54:02.947204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:02.947204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:02.947204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 641/1256] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:02.955076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6149-07e0-481a-8a28-e64ec3393ee4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:03.042789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:03.055410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6149-07e0-481a-8a28-e64ec3393ee4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:03.091952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:03.093188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:03.093506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:03.093779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:03.095496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:03.095802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:03.097176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:03.108837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 616/1257] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:03.114783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:03.220911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13968-ebbd-4fe6-bf7a-19d59619bb1e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:03.255313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:03.255939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:03.256218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:03.256510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:03.263263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:03.265587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:54:03.277004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:03.278769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:03.279670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 642/1258] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:54:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:03.285189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:03.388255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdefdab-f29a-4c07-b893-d5bc624fd5f6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:03.423546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b618489-ef99-4334-ab74-2a138035e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:03.424200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b618489-ef99-4334-ab74-2a138035e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:03.424513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b618489-ef99-4334-ab74-2a138035e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:03.424797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b618489-ef99-4334-ab74-2a138035e6c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:03.425490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b618489-ef99-4334-ab74-2a138035e6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:03.425800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b618489-ef99-4334-ab74-2a138035e6c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:03.427253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b618489-ef99-4334-ab74-2a138035e6c4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:03.440545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 617/1259] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:03.446811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:03.477076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:03.549798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99dd05-1e0a-435f-8b33-f62eb1d75b9d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:03.584611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a52952-1bff-43c9-9752-1d9d274faf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:03.585232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a52952-1bff-43c9-9752-1d9d274faf01 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:03.585514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a52952-1bff-43c9-9752-1d9d274faf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:03.585792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a52952-1bff-43c9-9752-1d9d274faf01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:03.586642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a52952-1bff-43c9-9752-1d9d274faf01 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=9e921d9249fb49d4ad9c94caa6691a6b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:03.586960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a52952-1bff-43c9-9752-1d9d274faf01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:03.588703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a52952-1bff-43c9-9752-1d9d274faf01 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:03.595072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 643/1260] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:54:03 2022] GET /identity/v3/role_assignments?user.id=9e921d9249fb49d4ad9c94caa6691a6b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:05.757270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab928-dcf1-4d6c-b445-12f2ea0950b1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:05.757818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab928-dcf1-4d6c-b445-12f2ea0950b1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:05.757818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab928-dcf1-4d6c-b445-12f2ea0950b1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:05.759135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 618/1261] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:05.765039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f697-e011-4595-9188-d09706f166da None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:05.765720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f697-e011-4595-9188-d09706f166da None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:05.765720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f697-e011-4595-9188-d09706f166da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:05.784229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f1e7f697-e011-4595-9188-d09706f166da None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:05.785461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f1e7f697-e011-4595-9188-d09706f166da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:05.853026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 644/1262] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:54:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:54:06.140569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ab928-dcf1-4d6c-b445-12f2ea0950b1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:06.151375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:06.240548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ab928-dcf1-4d6c-b445-12f2ea0950b1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:06.277114 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f983ca-4043-40d8-8a44-b771b80a3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:06.277804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f983ca-4043-40d8-8a44-b771b80a3668 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:06.278090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f983ca-4043-40d8-8a44-b771b80a3668 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:06.278369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f983ca-4043-40d8-8a44-b771b80a3668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:06.289318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f983ca-4043-40d8-8a44-b771b80a3668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-65f983ca-4043-40d8-8a44-b771b80a3668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:54:06.295444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:06.297339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:06.298635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 619/1263] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:54:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:54:06.303930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7f697-e011-4595-9188-d09706f166da None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:06.323221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:06.407390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7f697-e011-4595-9188-d09706f166da None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:06.441291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:06.441902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:06.442185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:06.442460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:06.443126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:06.443431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:06.444833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:06.453117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 645/1264] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:06.458993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f983ca-4043-40d8-8a44-b771b80a3668 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:06.526709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:06.560616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f983ca-4043-40d8-8a44-b771b80a3668 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:06.594615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:06.595238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:06.595519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:06.595808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:06.605994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:06.607421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:54:06.621993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:06.623178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:54:06.624628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:54:06.624628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:06.624628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:06.624628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 620/1265] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:06.629494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:06.722597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:06.741662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85f95e-c0bd-479a-be15-014d4dbe69f6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:06.775006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:06.775676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:06.775883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:06.776150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:06.777227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:06.777227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:06.778458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:06.791081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 646/1266] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:06.797651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:06.901090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333ebb-069e-4eb4-b88f-d0983c64d3b0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:06.923186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:06.936990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:06.937452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:06.937730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:06.937998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:06.945233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:06.946665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:54:06.958634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:06.959802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:06.964994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 621/1267] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:06.966911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:07.073145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dec56-9a03-492b-8b75-4cac8df9c503 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:07.110045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:07.110654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:07.110934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:07.111207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:07.111936 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:07.112239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:07.113705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:07.123431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:07.131864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 647/1268] 10.222.0.75 () {56 vars in 1143 bytes} [Mon Sep 19 14:54:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:07.144802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:07.239286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62978022-58e1-4d07-9a36-6ea3716367db None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:07.273963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:07.274591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:07.274874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:07.275151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:07.285832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:07.287763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:54:07.301358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:07.302467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:54:07.303598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:54:07.303598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:07.303598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:07.303598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 622/1269] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:07.308363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:07.413017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b811ce3-4c62-4340-af15-e6f76d349fca None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:07.447375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:07.453918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:07.453918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:07.453918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:07.453918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:07.453918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:07.453918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:07.462877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 648/1270] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:07.468638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:07.500785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:07.567974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa674a-f18b-46da-9bd6-1c1878e07525 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:07.601728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:07.602370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:07.602654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:07.603024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:07.615191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:07.616671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:54:07.629728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:07.630944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:07.632147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 623/1271] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:54:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:07.636903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:07.696353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:07.738099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1e625-1e7b-4e44-a41a-1a107c8535fb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:07.771770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10c4d4-c9e3-470a-ad0c-92bf7cd3f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:07.786148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10c4d4-c9e3-470a-ad0c-92bf7cd3f5cf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:07.786148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10c4d4-c9e3-470a-ad0c-92bf7cd3f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:07.786148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10c4d4-c9e3-470a-ad0c-92bf7cd3f5cf None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:07.786148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10c4d4-c9e3-470a-ad0c-92bf7cd3f5cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:07.786148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10c4d4-c9e3-470a-ad0c-92bf7cd3f5cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:07.786148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10c4d4-c9e3-470a-ad0c-92bf7cd3f5cf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:07.787586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 649/1272] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:54:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:07.793522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:07.889628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:07.899413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694953b-bf07-4480-b3a4-260ebbf478fc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:07.933636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed62c00-2eb2-4b06-816c-f6fc550323aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:07.934326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed62c00-2eb2-4b06-816c-f6fc550323aa None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:07.944537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed62c00-2eb2-4b06-816c-f6fc550323aa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:07.944537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed62c00-2eb2-4b06-816c-f6fc550323aa None admin] PATH_INFO: `/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/9e921d9249fb49d4ad9c94caa6691a6b/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:07.944537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed62c00-2eb2-4b06-816c-f6fc550323aa None admin] RBAC: Authorizing `identity:create_grant(project_id=8ff25aa94bb840c1afb969d7b5c80d7c, user_id=9e921d9249fb49d4ad9c94caa6691a6b, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:07.944537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed62c00-2eb2-4b06-816c-f6fc550323aa None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:08.121707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 624/1273] 10.222.0.75 () {58 vars in 1439 bytes} [Mon Sep 19 14:54:07 2022] PUT /identity/v3/projects/8ff25aa94bb840c1afb969d7b5c80d7c/users/9e921d9249fb49d4ad9c94caa6691a6b/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:54:10.278981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842101d-5455-4696-91c5-f921439b95ec None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:10.279559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842101d-5455-4696-91c5-f921439b95ec None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:10.279559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842101d-5455-4696-91c5-f921439b95ec None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:10.284583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 650/1274] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:54:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:10.292925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef65993-ee28-4862-be76-1febf8bb0d10 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:10.293774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef65993-ee28-4862-be76-1febf8bb0d10 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:10.293774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef65993-ee28-4862-be76-1febf8bb0d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:10.312861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6ef65993-ee28-4862-be76-1febf8bb0d10 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:10.314067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6ef65993-ee28-4862-be76-1febf8bb0d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:10.383542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 625/1275] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:54:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:54:10.659169 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842101d-5455-4696-91c5-f921439b95ec None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:10.766778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842101d-5455-4696-91c5-f921439b95ec None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:10.784279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:10.801757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee76dcd-8155-48ba-b2a2-288b48d0e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:10.802384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76dcd-8155-48ba-b2a2-288b48d0e311 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:10.802666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76dcd-8155-48ba-b2a2-288b48d0e311 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:10.802938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76dcd-8155-48ba-b2a2-288b48d0e311 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:10.813529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee76dcd-8155-48ba-b2a2-288b48d0e311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6ee76dcd-8155-48ba-b2a2-288b48d0e311 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:54:10.818354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:10.819460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:10.820416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 651/1276] 10.222.0.75 () {56 vars in 1096 bytes} [Mon Sep 19 14:54:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:10.825512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef65993-ee28-4862-be76-1febf8bb0d10 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:10.907660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:10.925721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef65993-ee28-4862-be76-1febf8bb0d10 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:10.959158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:10.959759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:10.960035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:10.960355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:10.961091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:10.961394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:10.963026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:10.971425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 626/1277] 10.222.0.75 () {56 vars in 1099 bytes} [Mon Sep 19 14:54:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:10.977450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee76dcd-8155-48ba-b2a2-288b48d0e311 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:11.089130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee76dcd-8155-48ba-b2a2-288b48d0e311 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:11.123569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:11.124746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:11.125025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:11.125298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:11.135308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:11.136793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:54:11.151980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:11.153050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:54:11.154111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:54:11.154111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:11.154111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:11.154111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 652/1278] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:11.159408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:11.259433 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2008ca5-2c79-4344-a70f-a93ee3d085d1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:11.294920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:11.295605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:11.296801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:11.297039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:11.297674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:11.297974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:11.299312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:11.310730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 627/1279] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:11.316946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:11.349798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:11.419987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc1e7-3709-4712-90e1-7884ce67aaca None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:11.460775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:11.461561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:11.461972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:11.462437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:11.471544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:11.473015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:54:11.484698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:11.485849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:11.486805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 653/1280] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:11.491956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:11.495719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:11.595866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5a3e-e830-4282-a1f3-4073af92946b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:11.632640 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:11.633249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:11.633533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:11.633811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:11.634541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:11.634847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:11.636274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:11.656505 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 628/1281] 10.222.0.75 () {56 vars in 1143 bytes} [Mon Sep 19 14:54:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:11.662248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:11.757057 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:11.767892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31178994-7f88-42d2-a493-df8d0ff9dba4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:11.803573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffb0b7-4823-4ddf-81be-7b415f468cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:11.804179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffb0b7-4823-4ddf-81be-7b415f468cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:11.804463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffb0b7-4823-4ddf-81be-7b415f468cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:11.804773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffb0b7-4823-4ddf-81be-7b415f468cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:11.874284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffb0b7-4823-4ddf-81be-7b415f468cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:11.875647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffb0b7-4823-4ddf-81be-7b415f468cb9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:11.967398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:11.978728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 654/1282] 10.222.0.75 () {58 vars in 1282 bytes} [Mon Sep 19 14:54:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:54:11.984861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:12.050311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:12.088814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bb37-ca2f-416f-bdbd-24c75d8a588f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:12.133543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:12.133543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:12.133543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:12.133543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:12.142900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:12.144376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:54:12.161274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:12.162293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:54:12.163768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:54:12.163768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:54:12.163768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:12.163768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 629/1283] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 14:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:12.168397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffb0b7-4823-4ddf-81be-7b415f468cb9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:12.278628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffb0b7-4823-4ddf-81be-7b415f468cb9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:12.317025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:12.317688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:12.317922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:12.318196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:12.318854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:12.319159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:12.320579 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:12.338116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 655/1284] 10.222.0.75 () {56 vars in 1109 bytes} [Mon Sep 19 14:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:12.344852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:12.455613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b855-8595-4507-84c8-00bb554f1ca4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:12.471625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:12.492716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:12.493382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:12.493664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:12.493938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:12.501651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:12.503237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:54:12.515811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:12.517014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: ERROR keystone.server.flask.application Sep 19 14:54:12.517969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 630/1285] 10.222.0.75 () {56 vars in 1111 bytes} [Mon Sep 19 14:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:12.522995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:12.575365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:12.627268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf5236-f561-48e4-a542-f9c9bbd72cf6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:12.661946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a9fae-db7b-4aa4-ad9d-f7c633612d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:12.662550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9fae-db7b-4aa4-ad9d-f7c633612d29 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:12.662853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9fae-db7b-4aa4-ad9d-f7c633612d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:12.663173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9fae-db7b-4aa4-ad9d-f7c633612d29 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:12.663869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a9fae-db7b-4aa4-ad9d-f7c633612d29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:12.664174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a9fae-db7b-4aa4-ad9d-f7c633612d29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:12.665633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a9fae-db7b-4aa4-ad9d-f7c633612d29 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:12.677983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 656/1286] 10.222.0.75 () {56 vars in 1148 bytes} [Mon Sep 19 14:54:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:12.684106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:12.796271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eb7f1-ae15-4d04-bb99-99998fbb30ab None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:12.836197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49676998-438d-4f8c-8025-c05ddcb92416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:12.836833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676998-438d-4f8c-8025-c05ddcb92416 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:12.837116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676998-438d-4f8c-8025-c05ddcb92416 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:12.837391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49676998-438d-4f8c-8025-c05ddcb92416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:12.838381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49676998-438d-4f8c-8025-c05ddcb92416 None admin] RBAC: Adding query filter params (role.id=0bfe1c3e776e4192a1fac501682555a6, scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c, user.id=9e921d9249fb49d4ad9c94caa6691a6b) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:12.838691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49676998-438d-4f8c-8025-c05ddcb92416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:12.840117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49676998-438d-4f8c-8025-c05ddcb92416 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:12.846334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 631/1287] 10.222.0.75 () {56 vars in 1374 bytes} [Mon Sep 19 14:54:12 2022] GET /identity/v3/role_assignments?user.id=9e921d9249fb49d4ad9c94caa6691a6b&scope.project.id=8ff25aa94bb840c1afb969d7b5c80d7c&role.id=0bfe1c3e776e4192a1fac501682555a6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:15.019551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703b3e-e8fd-4be8-8ae8-f5362806eb48 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:15.020136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703b3e-e8fd-4be8-8ae8-f5362806eb48 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:15.020136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703b3e-e8fd-4be8-8ae8-f5362806eb48 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:15.021448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 657/1288] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:15.027074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f375-be05-4580-8942-2512dee759e4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:15.027680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f375-be05-4580-8942-2512dee759e4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:15.027680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f375-be05-4580-8942-2512dee759e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:15.047248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3ce7f375-be05-4580-8942-2512dee759e4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:15.048498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3ce7f375-be05-4580-8942-2512dee759e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:15.078771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:15.115621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 632/1289] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:54:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:54:15.388875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50703b3e-e8fd-4be8-8ae8-f5362806eb48 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:15.508853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50703b3e-e8fd-4be8-8ae8-f5362806eb48 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:15.521036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:15.543865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:15.544505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:15.544799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:15.545074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:15.545710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:15.547520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:15.556238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:15.560344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:15.562275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 658/1290] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:54:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:15.564292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7f375-be05-4580-8942-2512dee759e4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:15.662678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7f375-be05-4580-8942-2512dee759e4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:15.697122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878747c-bc48-48b3-8891-e375406000af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:15.697725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878747c-bc48-48b3-8891-e375406000af None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:15.698006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878747c-bc48-48b3-8891-e375406000af None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:15.698279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878747c-bc48-48b3-8891-e375406000af None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:15.698905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878747c-bc48-48b3-8891-e375406000af None admin] RBAC: Adding query filter params (name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:15.699209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878747c-bc48-48b3-8891-e375406000af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:15.700606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878747c-bc48-48b3-8891-e375406000af None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:15.706151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 633/1291] 10.222.0.75 () {56 vars in 1116 bytes} [Mon Sep 19 14:54:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:15.712074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:15.814651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4210-ca5a-46cd-8b1a-77e40eb21cad None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:15.848086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f070a-de24-4bb0-8ab7-c4c8fcb7958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:15.848683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f070a-de24-4bb0-8ab7-c4c8fcb7958e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:15.848963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f070a-de24-4bb0-8ab7-c4c8fcb7958e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:15.849235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f070a-de24-4bb0-8ab7-c4c8fcb7958e None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:15.849858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f070a-de24-4bb0-8ab7-c4c8fcb7958e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:15.850159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f070a-de24-4bb0-8ab7-c4c8fcb7958e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:15.851517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f070a-de24-4bb0-8ab7-c4c8fcb7958e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:15.855889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 659/1292] 10.222.0.75 () {56 vars in 1116 bytes} [Mon Sep 19 14:54:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:18.032151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624fdb-b014-4e27-9fa3-8ef549973f0e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:18.032728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624fdb-b014-4e27-9fa3-8ef549973f0e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:18.032728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a624fdb-b014-4e27-9fa3-8ef549973f0e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:18.033981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 634/1293] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:18.039161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffefc-054f-47d6-b8b6-02d887dee50b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:18.039539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffefc-054f-47d6-b8b6-02d887dee50b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:18.039704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffefc-054f-47d6-b8b6-02d887dee50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:18.058337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-eb3ffefc-054f-47d6-b8b6-02d887dee50b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:18.059560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-eb3ffefc-054f-47d6-b8b6-02d887dee50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:18.090524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:18.128457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 660/1294] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:54:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:54:18.395968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a624fdb-b014-4e27-9fa3-8ef549973f0e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:18.427249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:18.501256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a624fdb-b014-4e27-9fa3-8ef549973f0e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:18.536225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a838f-f7d9-4a09-a2c6-19c1925ec0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:18.536868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a838f-f7d9-4a09-a2c6-19c1925ec0f8 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:18.537148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a838f-f7d9-4a09-a2c6-19c1925ec0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:18.537422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a838f-f7d9-4a09-a2c6-19c1925ec0f8 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:18.538079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a838f-f7d9-4a09-a2c6-19c1925ec0f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:18.539432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a838f-f7d9-4a09-a2c6-19c1925ec0f8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:18.651582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 635/1295] 10.222.0.75 () {60 vars in 1141 bytes} [Mon Sep 19 14:54:18 2022] POST /identity/v3/services => generated 246 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:54:20.989904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753742f0-d6db-418f-bca4-d2a54dcd0930 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:20.990450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753742f0-d6db-418f-bca4-d2a54dcd0930 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:20.990560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753742f0-d6db-418f-bca4-d2a54dcd0930 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:20.991824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 661/1296] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:20.997340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180044b-1fbb-49d3-b332-453d51ee0fd3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:20.997763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180044b-1fbb-49d3-b332-453d51ee0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:20.997889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180044b-1fbb-49d3-b332-453d51ee0fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:21.017338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c180044b-1fbb-49d3-b332-453d51ee0fd3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:21.018522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c180044b-1fbb-49d3-b332-453d51ee0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:21.091441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 636/1297] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:54:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:54:21.369050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753742f0-d6db-418f-bca4-d2a54dcd0930 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:21.470165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753742f0-d6db-418f-bca4-d2a54dcd0930 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:21.505011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:21.505631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:21.505908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:21.506179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:21.506751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:21.508105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:21.517338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:21.518559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:21.519756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 662/1298] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:54:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:21.525758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180044b-1fbb-49d3-b332-453d51ee0fd3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:21.546846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:21.627454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180044b-1fbb-49d3-b332-453d51ee0fd3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:21.661687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:21.662291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:21.662566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:21.662836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:21.663458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:21.663756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:21.665187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:21.670467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 637/1299] 10.222.0.75 () {56 vars in 1116 bytes} [Mon Sep 19 14:54:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:21.677286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:21.710162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:21.781258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f04f-b4b4-4b88-93b6-716a63ffbf4b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:21.819806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3b5ce-dfab-4834-a8a9-6742b2244cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:21.820413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b5ce-dfab-4834-a8a9-6742b2244cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:21.820725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b5ce-dfab-4834-a8a9-6742b2244cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:21.821002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b5ce-dfab-4834-a8a9-6742b2244cb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:21.821708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3b5ce-dfab-4834-a8a9-6742b2244cb1 None admin] RBAC: Adding query filter params (interface=public, service_id=08a83a6caf6f4c47b23e41f8e533dfa5, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:21.822016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3b5ce-dfab-4834-a8a9-6742b2244cb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:21.823381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3b5ce-dfab-4834-a8a9-6742b2244cb1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:21.829081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 663/1300] 10.222.0.75 () {56 vars in 1251 bytes} [Mon Sep 19 14:54:21 2022] GET /identity/v3/endpoints?service_id=08a83a6caf6f4c47b23e41f8e533dfa5&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:21.834938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:21.918866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:21.936230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f590585-861e-459a-b7a0-991f9c8fba9d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:21.971121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14713f-87b3-4dec-b211-91e4afbb7b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:21.971732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14713f-87b3-4dec-b211-91e4afbb7b78 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:21.972018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14713f-87b3-4dec-b211-91e4afbb7b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:21.972292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14713f-87b3-4dec-b211-91e4afbb7b78 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:21.972929 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14713f-87b3-4dec-b211-91e4afbb7b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:21.974287 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14713f-87b3-4dec-b211-91e4afbb7b78 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:21.981137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 638/1301] 10.222.0.75 () {56 vars in 1087 bytes} [Mon Sep 19 14:54:21 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:54:24.153602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc68d1-32a0-4d78-ba9b-70fabbb7e47e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:24.154157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc68d1-32a0-4d78-ba9b-70fabbb7e47e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:24.154157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc68d1-32a0-4d78-ba9b-70fabbb7e47e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:24.155514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 664/1302] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 14:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:54:24.160720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eacb3f-3dc2-40d4-9b40-bed8cb0905fa None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:24.161100 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eacb3f-3dc2-40d4-9b40-bed8cb0905fa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:24.161283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eacb3f-3dc2-40d4-9b40-bed8cb0905fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:24.179706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-77eacb3f-3dc2-40d4-9b40-bed8cb0905fa None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:54:24.185345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-77eacb3f-3dc2-40d4-9b40-bed8cb0905fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:54:24.247957 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 639/1303] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 14:54:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:54:24.526152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc68d1-32a0-4d78-ba9b-70fabbb7e47e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:24.623075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:24.629918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc68d1-32a0-4d78-ba9b-70fabbb7e47e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:24.662747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:24.667505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:24.667505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:24.667505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:24.667505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:24.667505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:54:24.675248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:54:24.676444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 14:54:24.677480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 665/1304] 10.222.0.75 () {56 vars in 1117 bytes} [Mon Sep 19 14:54:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:54:24.682372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eacb3f-3dc2-40d4-9b40-bed8cb0905fa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:24.760994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:24.788522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eacb3f-3dc2-40d4-9b40-bed8cb0905fa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:24.823575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783878a-cd70-4fd5-be0e-e7d5a451690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:24.824171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783878a-cd70-4fd5-be0e-e7d5a451690b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:24.824444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783878a-cd70-4fd5-be0e-e7d5a451690b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:24.824741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783878a-cd70-4fd5-be0e-e7d5a451690b None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:24.825360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783878a-cd70-4fd5-be0e-e7d5a451690b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:54:24.825655 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783878a-cd70-4fd5-be0e-e7d5a451690b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:24.827518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783878a-cd70-4fd5-be0e-e7d5a451690b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:24.832994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 640/1305] 10.222.0.75 () {56 vars in 1116 bytes} [Mon Sep 19 14:54:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:54:24.839099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:54:24.942513 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa103fb8-e0d6-4353-a276-f8ebe39316a4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:54:24.977842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c2443-074a-4a37-9807-a0510e520016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:54:24.978478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c2443-074a-4a37-9807-a0510e520016 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:54:24.978837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c2443-074a-4a37-9807-a0510e520016 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:54:24.979116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c2443-074a-4a37-9807-a0510e520016 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:54:24.979778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c2443-074a-4a37-9807-a0510e520016 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:54:24.981167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c2443-074a-4a37-9807-a0510e520016 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:54:25.060504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 666/1306] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 14:54:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:54:34.829771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=30 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:35.055893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:57.603059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49806-0f24-4888-afe4-3c361248144d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:57.603504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49806-0f24-4888-afe4-3c361248144d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:57.603659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49806-0f24-4888-afe4-3c361248144d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:57.608945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 641/1307] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:00:57.613904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba500-e0c6-4a35-8040-fb6a5ac6baa9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:57.615218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba500-e0c6-4a35-8040-fb6a5ac6baa9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:57.616236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba500-e0c6-4a35-8040-fb6a5ac6baa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:57.758743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4a1ba500-e0c6-4a35-8040-fb6a5ac6baa9 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:57.760105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4a1ba500-e0c6-4a35-8040-fb6a5ac6baa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:57.905164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 667/1308] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:58.210192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f417d-d278-4604-aa90-2aeeeb185a79 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:58.210967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f417d-d278-4604-aa90-2aeeeb185a79 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:58.211448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f417d-d278-4604-aa90-2aeeeb185a79 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:58.213344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 642/1309] 10.222.0.75 () {54 vars in 963 bytes} [Mon Sep 19 15:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:00:58.220507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e491b-75d8-47b1-bcf6-3a26d506bf35 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:58.221455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e491b-75d8-47b1-bcf6-3a26d506bf35 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:58.221913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e491b-75d8-47b1-bcf6-3a26d506bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:58.326141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e14e491b-75d8-47b1-bcf6-3a26d506bf35 None None] MFA Rules not processed for user `67d0bbf089504d408db0bb7055a780a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:58.327834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e14e491b-75d8-47b1-bcf6-3a26d506bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:58.353993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:58.432094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f417d-d278-4604-aa90-2aeeeb185a79 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:58.435107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f30f417d-d278-4604-aa90-2aeeeb185a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:58.440113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 668/1310] 10.222.0.75 () {58 vars in 1060 bytes} [Mon Sep 19 15:00:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:58.570512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f417d-d278-4604-aa90-2aeeeb185a79 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:58.658398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87dc1a-d385-47c0-9208-42cd7f81f873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:58.659068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87dc1a-d385-47c0-9208-42cd7f81f873 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:58.659282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87dc1a-d385-47c0-9208-42cd7f81f873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:58.659555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87dc1a-d385-47c0-9208-42cd7f81f873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:58.661187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0d87dc1a-d385-47c0-9208-42cd7f81f873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:58.722769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:58.795614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87dc1a-d385-47c0-9208-42cd7f81f873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:58.797697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87dc1a-d385-47c0-9208-42cd7f81f873 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:58.835309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 643/1311] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:01:01.398488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a251-1abd-4028-a5c8-e10ff5186abc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:01.399011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a251-1abd-4028-a5c8-e10ff5186abc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:01.399011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a251-1abd-4028-a5c8-e10ff5186abc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:01.400284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 669/1312] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:01.405967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde44bd-6d71-4cc0-b829-7a7b4192a65f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:01.406362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde44bd-6d71-4cc0-b829-7a7b4192a65f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:01.406527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde44bd-6d71-4cc0-b829-7a7b4192a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:01.491014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8fde44bd-6d71-4cc0-b829-7a7b4192a65f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:01.492228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8fde44bd-6d71-4cc0-b829-7a7b4192a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:01.588240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 644/1313] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:01.876880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a251-1abd-4028-a5c8-e10ff5186abc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:01.878434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5742a251-1abd-4028-a5c8-e10ff5186abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:01.986890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a251-1abd-4028-a5c8-e10ff5186abc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:02.061952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:02.064255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c115-c705-4452-b7a1-ff3c64b78ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:02.064887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c115-c705-4452-b7a1-ff3c64b78ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:02.065180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c115-c705-4452-b7a1-ff3c64b78ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:02.065450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c115-c705-4452-b7a1-ff3c64b78ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:02.067048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9cd0c115-c705-4452-b7a1-ff3c64b78ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:02.178423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c115-c705-4452-b7a1-ff3c64b78ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:02.179868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c115-c705-4452-b7a1-ff3c64b78ee3 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:02.199880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 670/1314] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:05.018567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c71f-b7d3-4cdc-9408-5a898ee0bfbd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:05.019121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c71f-b7d3-4cdc-9408-5a898ee0bfbd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:05.019121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c71f-b7d3-4cdc-9408-5a898ee0bfbd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:05.020445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 645/1315] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:05.025900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e512-7fc9-4b7b-9979-bccda0894e5a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:05.026320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e512-7fc9-4b7b-9979-bccda0894e5a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:05.026458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e512-7fc9-4b7b-9979-bccda0894e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:05.091922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7a84e512-7fc9-4b7b-9979-bccda0894e5a None None] MFA Rules not processed for user `f2ea2cda24db4580a183f631c5970850`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:05.093595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7a84e512-7fc9-4b7b-9979-bccda0894e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:05.145694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:05.190252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 671/1316] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:05.478043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c71f-b7d3-4cdc-9408-5a898ee0bfbd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:05.479633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7f44c71f-b7d3-4cdc-9408-5a898ee0bfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:05.489949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:05.594464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c71f-b7d3-4cdc-9408-5a898ee0bfbd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:05.672737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69025aa-9d47-42b0-9f3b-caa42750eee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:05.673345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69025aa-9d47-42b0-9f3b-caa42750eee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:05.673622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69025aa-9d47-42b0-9f3b-caa42750eee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:05.673892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69025aa-9d47-42b0-9f3b-caa42750eee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:05.675476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f69025aa-9d47-42b0-9f3b-caa42750eee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:05.736713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:05.783027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69025aa-9d47-42b0-9f3b-caa42750eee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:05.784463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69025aa-9d47-42b0-9f3b-caa42750eee3 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:05.803431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 646/1317] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:08.737935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c059-f90a-4a07-9561-23dc724b6374 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:08.738482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c059-f90a-4a07-9561-23dc724b6374 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:08.738482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c059-f90a-4a07-9561-23dc724b6374 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:08.739911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 672/1318] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:08.745414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82287-1558-4a2b-841e-11dbb8262362 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:08.746526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82287-1558-4a2b-841e-11dbb8262362 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:08.746526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c82287-1558-4a2b-841e-11dbb8262362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:08.816352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-23c82287-1558-4a2b-841e-11dbb8262362 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:08.817985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-23c82287-1558-4a2b-841e-11dbb8262362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:08.914401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 647/1319] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:09.215578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9013d28-f6c1-4d8e-9546-74b3f5aac9af None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:09.215861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9013d28-f6c1-4d8e-9546-74b3f5aac9af None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:09.216142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9013d28-f6c1-4d8e-9546-74b3f5aac9af None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:09.217548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 673/1320] 10.222.0.75 () {54 vars in 963 bytes} [Mon Sep 19 15:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:09.223828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c3317-c4cc-41d5-8e08-588a7baccaaf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:09.224114 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c3317-c4cc-41d5-8e08-588a7baccaaf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:09.224386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c3317-c4cc-41d5-8e08-588a7baccaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:09.246993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:09.301961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3a7c3317-c4cc-41d5-8e08-588a7baccaaf None None] MFA Rules not processed for user `67d0bbf089504d408db0bb7055a780a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:09.303208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3a7c3317-c4cc-41d5-8e08-588a7baccaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:09.379810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 648/1321] 10.222.0.75 () {58 vars in 1060 bytes} [Mon Sep 19 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:09.389540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9013d28-f6c1-4d8e-9546-74b3f5aac9af None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:09.391099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b9013d28-f6c1-4d8e-9546-74b3f5aac9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:09.492068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9013d28-f6c1-4d8e-9546-74b3f5aac9af None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:09.566160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721c902-2a2d-4b03-8173-5762fefab866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:09.566790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c902-2a2d-4b03-8173-5762fefab866 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:09.567067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c902-2a2d-4b03-8173-5762fefab866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:09.567338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c902-2a2d-4b03-8173-5762fefab866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:09.568951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e721c902-2a2d-4b03-8173-5762fefab866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:09.576568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:09.679987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721c902-2a2d-4b03-8173-5762fefab866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:09.681388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721c902-2a2d-4b03-8173-5762fefab866 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:09.699162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 674/1322] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:13.582714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1613670-5905-4d80-b22d-f822c4d23fd5 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:13.583295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1613670-5905-4d80-b22d-f822c4d23fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:13.583295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1613670-5905-4d80-b22d-f822c4d23fd5 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:13.584649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 649/1323] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:13.590928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2864-6f10-4fbf-a485-7c78d8be7647 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:13.591402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2864-6f10-4fbf-a485-7c78d8be7647 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:13.591506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2864-6f10-4fbf-a485-7c78d8be7647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:13.659170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5e1f2864-6f10-4fbf-a485-7c78d8be7647 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:13.660382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5e1f2864-6f10-4fbf-a485-7c78d8be7647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:13.721685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:13.763551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 675/1324] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:14.049047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1613670-5905-4d80-b22d-f822c4d23fd5 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:14.050583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d1613670-5905-4d80-b22d-f822c4d23fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:14.155691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1613670-5905-4d80-b22d-f822c4d23fd5 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:14.170967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:14.238286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99634c0-fd95-466a-b8a9-f24595ee2420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:14.238783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99634c0-fd95-466a-b8a9-f24595ee2420 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:14.239066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99634c0-fd95-466a-b8a9-f24595ee2420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:14.239347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99634c0-fd95-466a-b8a9-f24595ee2420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:14.240991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c99634c0-fd95-466a-b8a9-f24595ee2420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:14.353694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99634c0-fd95-466a-b8a9-f24595ee2420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:14.355764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99634c0-fd95-466a-b8a9-f24595ee2420 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:14.375068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 650/1325] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:16.635096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e8415-7f1c-420a-bd15-27b17139e75a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:16.635695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e8415-7f1c-420a-bd15-27b17139e75a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:16.635695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e8415-7f1c-420a-bd15-27b17139e75a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:16.638039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 676/1326] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:16.643712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12bdd-1142-46bf-a65a-5e44c92ae2ba None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:16.644190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12bdd-1142-46bf-a65a-5e44c92ae2ba None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:16.644396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12bdd-1142-46bf-a65a-5e44c92ae2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:16.696834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:16.717148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-13b12bdd-1142-46bf-a65a-5e44c92ae2ba None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:16.718402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13b12bdd-1142-46bf-a65a-5e44c92ae2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:16.834442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 651/1327] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:17.114316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e8415-7f1c-420a-bd15-27b17139e75a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:17.115888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6d3e8415-7f1c-420a-bd15-27b17139e75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:17.222317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e8415-7f1c-420a-bd15-27b17139e75a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:17.296385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d810-b2cb-404f-b9e1-0bff3426b1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:17.297014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d810-b2cb-404f-b9e1-0bff3426b1fe service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.297292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d810-b2cb-404f-b9e1-0bff3426b1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.297558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d810-b2cb-404f-b9e1-0bff3426b1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.299132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7103d810-b2cb-404f-b9e1-0bff3426b1fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:17.317037 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:17.409696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d810-b2cb-404f-b9e1-0bff3426b1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:17.411058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d810-b2cb-404f-b9e1-0bff3426b1fe service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:17.431369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 677/1328] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:19.680635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2cc5-5bc1-4892-a13a-81000bb3ba37 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:19.681129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2cc5-5bc1-4892-a13a-81000bb3ba37 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:19.681237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2cc5-5bc1-4892-a13a-81000bb3ba37 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:19.682531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 652/1329] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:19.688209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4e28-c7a3-45e4-9dce-61886d724504 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:19.688704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4e28-c7a3-45e4-9dce-61886d724504 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:19.688857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4e28-c7a3-45e4-9dce-61886d724504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:19.756180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1e4c4e28-c7a3-45e4-9dce-61886d724504 None None] MFA Rules not processed for user `f2ea2cda24db4580a183f631c5970850`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:19.757423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1e4c4e28-c7a3-45e4-9dce-61886d724504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:19.822332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:19.855160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 678/1330] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:01:20.149625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca2cc5-5bc1-4892-a13a-81000bb3ba37 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:20.151164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-91ca2cc5-5bc1-4892-a13a-81000bb3ba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:20.264275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca2cc5-5bc1-4892-a13a-81000bb3ba37 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:20.287939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:20.346851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea9aef-424d-444d-8d8a-1dbb8fdd6e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:20.347464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9aef-424d-444d-8d8a-1dbb8fdd6e99 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:20.347745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9aef-424d-444d-8d8a-1dbb8fdd6e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:20.348017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9aef-424d-444d-8d8a-1dbb8fdd6e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:20.349679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-34ea9aef-424d-444d-8d8a-1dbb8fdd6e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:20.470531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea9aef-424d-444d-8d8a-1dbb8fdd6e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:20.472189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea9aef-424d-444d-8d8a-1dbb8fdd6e99 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:20.491172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 653/1331] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:01:23.168405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a500697-edb4-48e4-9fe4-49800b5894d2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:23.168892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a500697-edb4-48e4-9fe4-49800b5894d2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:23.168892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a500697-edb4-48e4-9fe4-49800b5894d2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:23.170185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 679/1332] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:23.175914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb56468-b7a7-4ff7-ad39-2bb4afb3b641 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:23.176308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb56468-b7a7-4ff7-ad39-2bb4afb3b641 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:23.176465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb56468-b7a7-4ff7-ad39-2bb4afb3b641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:23.241375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:23.243980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cbb56468-b7a7-4ff7-ad39-2bb4afb3b641 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:23.245867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cbb56468-b7a7-4ff7-ad39-2bb4afb3b641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:23.344420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 654/1333] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:23.628259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a500697-edb4-48e4-9fe4-49800b5894d2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:23.629877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4a500697-edb4-48e4-9fe4-49800b5894d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:23.734773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a500697-edb4-48e4-9fe4-49800b5894d2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:23.813603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f75096-3dbe-4b01-be48-a4d98bb5e9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:23.814222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f75096-3dbe-4b01-be48-a4d98bb5e9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:23.814502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f75096-3dbe-4b01-be48-a4d98bb5e9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:23.814774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f75096-3dbe-4b01-be48-a4d98bb5e9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:23.816416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b2f75096-3dbe-4b01-be48-a4d98bb5e9b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:23.850890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:23.937600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f75096-3dbe-4b01-be48-a4d98bb5e9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:23.938957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f75096-3dbe-4b01-be48-a4d98bb5e9b2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:23.958825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 680/1334] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:26.170831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d1c6-7c1e-4977-bbe6-9242fb35fb24 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:26.171395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d1c6-7c1e-4977-bbe6-9242fb35fb24 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:26.171395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d1c6-7c1e-4977-bbe6-9242fb35fb24 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:26.172770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 655/1335] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:26.178094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3fcf-e67f-405c-a751-bbe5b4c95dd1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:26.178489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3fcf-e67f-405c-a751-bbe5b4c95dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:26.178645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3fcf-e67f-405c-a751-bbe5b4c95dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:26.256290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d2bf3fcf-e67f-405c-a751-bbe5b4c95dd1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:26.257548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d2bf3fcf-e67f-405c-a751-bbe5b4c95dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:26.332846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:26.356194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 681/1336] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:26.647216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4d1c6-7c1e-4977-bbe6-9242fb35fb24 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:26.648819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aaf4d1c6-7c1e-4977-bbe6-9242fb35fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:26.755096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4d1c6-7c1e-4977-bbe6-9242fb35fb24 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:26.784892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:26.843178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842be465-0470-4869-85df-31316a4295c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:26.843792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842be465-0470-4869-85df-31316a4295c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:26.844071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842be465-0470-4869-85df-31316a4295c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:26.844342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842be465-0470-4869-85df-31316a4295c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:26.846322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-842be465-0470-4869-85df-31316a4295c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:26.968347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842be465-0470-4869-85df-31316a4295c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:26.969709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842be465-0470-4869-85df-31316a4295c6 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:26.988224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 656/1337] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:29.705673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2237e-8f40-43da-a87b-87f3458e004e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:29.706188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2237e-8f40-43da-a87b-87f3458e004e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:29.706188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2237e-8f40-43da-a87b-87f3458e004e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:29.707499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 682/1338] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:29.712927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf3dc-4943-47c0-9e7e-9e8715dbeb15 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:29.713350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf3dc-4943-47c0-9e7e-9e8715dbeb15 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:29.713497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf3dc-4943-47c0-9e7e-9e8715dbeb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:29.781774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e4ecf3dc-4943-47c0-9e7e-9e8715dbeb15 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:29.783024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e4ecf3dc-4943-47c0-9e7e-9e8715dbeb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:29.791364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:29.880838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 657/1339] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:30.161931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2237e-8f40-43da-a87b-87f3458e004e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:30.163487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f5f2237e-8f40-43da-a87b-87f3458e004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:30.271902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2237e-8f40-43da-a87b-87f3458e004e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:30.346884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352317c-4557-48ee-baaa-550e40885a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:30.347490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352317c-4557-48ee-baaa-550e40885a39 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:30.347773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352317c-4557-48ee-baaa-550e40885a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:30.348045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352317c-4557-48ee-baaa-550e40885a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:30.349683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5352317c-4557-48ee-baaa-550e40885a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:30.387880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:30.463190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352317c-4557-48ee-baaa-550e40885a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:30.465455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352317c-4557-48ee-baaa-550e40885a39 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:30.485846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 683/1340] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:34.936752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ced26-1018-4eaa-bbf7-b4aa39fd806f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:34.937207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ced26-1018-4eaa-bbf7-b4aa39fd806f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:34.937324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ced26-1018-4eaa-bbf7-b4aa39fd806f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:34.942785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 658/1341] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:34.944163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7f11b-19e6-4fbc-be18-6e0c1a24e715 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:34.944617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7f11b-19e6-4fbc-be18-6e0c1a24e715 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:34.944799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7f11b-19e6-4fbc-be18-6e0c1a24e715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:35.015085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-63b7f11b-19e6-4fbc-be18-6e0c1a24e715 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:35.016303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-63b7f11b-19e6-4fbc-be18-6e0c1a24e715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:35.104000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:35.116516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 684/1342] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:01:35.403866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ced26-1018-4eaa-bbf7-b4aa39fd806f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:35.405437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-209ced26-1018-4eaa-bbf7-b4aa39fd806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:35.509896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ced26-1018-4eaa-bbf7-b4aa39fd806f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:35.548835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:35.590286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c890c-5714-4cb1-b8e7-7cb5c340f8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:35.590902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c890c-5714-4cb1-b8e7-7cb5c340f8dd service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:35.591187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c890c-5714-4cb1-b8e7-7cb5c340f8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:35.591463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c890c-5714-4cb1-b8e7-7cb5c340f8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:35.593161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b92c890c-5714-4cb1-b8e7-7cb5c340f8dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:35.709537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c890c-5714-4cb1-b8e7-7cb5c340f8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:35.710887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c890c-5714-4cb1-b8e7-7cb5c340f8dd service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:35.731544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 659/1343] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:38.842123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31db19-bcac-4846-ae22-e92a1f44375a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:38.842654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31db19-bcac-4846-ae22-e92a1f44375a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:38.842654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31db19-bcac-4846-ae22-e92a1f44375a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:38.844001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 685/1344] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:38.849472 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40d6e-d01d-4b59-ad22-c5e643201786 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:38.849901 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40d6e-d01d-4b59-ad22-c5e643201786 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:38.850009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40d6e-d01d-4b59-ad22-c5e643201786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:38.917522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6cd40d6e-d01d-4b59-ad22-c5e643201786 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:38.918607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6cd40d6e-d01d-4b59-ad22-c5e643201786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:38.937467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:39.021348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 660/1345] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:39.313155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31db19-bcac-4846-ae22-e92a1f44375a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:39.314707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cd31db19-bcac-4846-ae22-e92a1f44375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:39.443204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31db19-bcac-4846-ae22-e92a1f44375a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:39.517533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ed895-950c-41d7-99f7-fe2306015b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:39.518139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ed895-950c-41d7-99f7-fe2306015b39 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:39.518420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ed895-950c-41d7-99f7-fe2306015b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:39.518685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ed895-950c-41d7-99f7-fe2306015b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:39.520258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ed7ed895-950c-41d7-99f7-fe2306015b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:39.564868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:39.635797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ed895-950c-41d7-99f7-fe2306015b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:39.637259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ed895-950c-41d7-99f7-fe2306015b39 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:39.657553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 686/1346] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:44.436555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4a88-4982-4a66-8d6e-25c6fada8f99 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:44.437148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4a88-4982-4a66-8d6e-25c6fada8f99 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:44.437148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4a88-4982-4a66-8d6e-25c6fada8f99 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:44.439148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 661/1347] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:44.444962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566d09-4b71-4d25-801c-5cd5b476e624 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:44.445501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566d09-4b71-4d25-801c-5cd5b476e624 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:44.445501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566d09-4b71-4d25-801c-5cd5b476e624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:44.525590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-31566d09-4b71-4d25-801c-5cd5b476e624 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:44.527274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-31566d09-4b71-4d25-801c-5cd5b476e624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:44.646562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:44.649002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 687/1348] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:44.945213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4a88-4982-4a66-8d6e-25c6fada8f99 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:44.946761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-43ff4a88-4982-4a66-8d6e-25c6fada8f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:45.051738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4a88-4982-4a66-8d6e-25c6fada8f99 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:45.100599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:45.126962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44d7c-b823-44a6-a5fe-3b92a38f39a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:45.127573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44d7c-b823-44a6-a5fe-3b92a38f39a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:45.127832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44d7c-b823-44a6-a5fe-3b92a38f39a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:45.128103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44d7c-b823-44a6-a5fe-3b92a38f39a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:45.129717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7ba44d7c-b823-44a6-a5fe-3b92a38f39a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:45.257871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba44d7c-b823-44a6-a5fe-3b92a38f39a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:45.259327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba44d7c-b823-44a6-a5fe-3b92a38f39a3 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:45.279015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 662/1349] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:50.272329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595fe2-1b36-4e5e-bbba-a4ca2889afac None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.272808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595fe2-1b36-4e5e-bbba-a4ca2889afac None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.272899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21595fe2-1b36-4e5e-bbba-a4ca2889afac None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.274490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 688/1350] 10.222.0.75 () {54 vars in 921 bytes} [Mon Sep 19 15:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:50.279946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263525a-1d6b-4445-99b8-d55fdb214ae4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.283161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263525a-1d6b-4445-99b8-d55fdb214ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.283661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263525a-1d6b-4445-99b8-d55fdb214ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.421463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c263525a-1d6b-4445-99b8-d55fdb214ae4 None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:50.422956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c263525a-1d6b-4445-99b8-d55fdb214ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:50.457457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:50.573573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 663/1351] 10.222.0.75 () {58 vars in 1018 bytes} [Mon Sep 19 15:01:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:55.103424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e65c0d-5f8a-438e-819a-4ac269c2c24f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.104535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e65c0d-5f8a-438e-819a-4ac269c2c24f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.104535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e65c0d-5f8a-438e-819a-4ac269c2c24f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.105901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 689/1352] 10.222.0.75 () {54 vars in 921 bytes} [Mon Sep 19 15:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:55.110880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f261-5989-4541-b8d1-01aefc05e790 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.111315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f261-5989-4541-b8d1-01aefc05e790 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.111558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f261-5989-4541-b8d1-01aefc05e790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.226019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2c35f261-5989-4541-b8d1-01aefc05e790 None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:55.227175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2c35f261-5989-4541-b8d1-01aefc05e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:55.309820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:55.352617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 664/1353] 10.222.0.75 () {58 vars in 1018 bytes} [Mon Sep 19 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:56.468828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5126-c209-48f5-baef-bc1323c45bd0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.469329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5126-c209-48f5-baef-bc1323c45bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.469329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5126-c209-48f5-baef-bc1323c45bd0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.470630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 690/1354] 10.222.0.75 () {54 vars in 921 bytes} [Mon Sep 19 15:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:56.475951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884861c-1d79-4444-910d-e6825e77ed4c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.476406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884861c-1d79-4444-910d-e6825e77ed4c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.476536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884861c-1d79-4444-910d-e6825e77ed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.554994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9884861c-1d79-4444-910d-e6825e77ed4c None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:56.556204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9884861c-1d79-4444-910d-e6825e77ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:56.665281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 665/1355] 10.222.0.75 () {58 vars in 1018 bytes} [Mon Sep 19 15:01:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:00.286006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e27545-bb5e-4fe2-a2a0-2d1c259ea89f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:00.286494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e27545-bb5e-4fe2-a2a0-2d1c259ea89f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:00.286494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e27545-bb5e-4fe2-a2a0-2d1c259ea89f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:00.288118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 691/1356] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:00.293963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae989-fe9d-4d65-bd14-915fedfd4ffd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:00.294432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae989-fe9d-4d65-bd14-915fedfd4ffd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:00.294534 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae989-fe9d-4d65-bd14-915fedfd4ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:00.332353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:00.364945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5e9ae989-fe9d-4d65-bd14-915fedfd4ffd None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:00.366150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5e9ae989-fe9d-4d65-bd14-915fedfd4ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:00.468749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 666/1357] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:00.773697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711b83-4c03-4633-b5c6-f4f5bc59ba64 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:00.774262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711b83-4c03-4633-b5c6-f4f5bc59ba64 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:00.774771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67711b83-4c03-4633-b5c6-f4f5bc59ba64 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:00.777304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 692/1358] 10.222.0.75 () {54 vars in 965 bytes} [Mon Sep 19 15:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:00.785387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636b24-1b5b-437b-83c6-84d2c13552f4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:00.785681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636b24-1b5b-437b-83c6-84d2c13552f4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:00.785956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636b24-1b5b-437b-83c6-84d2c13552f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:00.876671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8b636b24-1b5b-437b-83c6-84d2c13552f4 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:00.877877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8b636b24-1b5b-437b-83c6-84d2c13552f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:00.930668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:01.007338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 667/1359] 10.222.0.75 () {58 vars in 1062 bytes} [Mon Sep 19 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:01.015154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67711b83-4c03-4633-b5c6-f4f5bc59ba64 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:01.017097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-67711b83-4c03-4633-b5c6-f4f5bc59ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:01.186151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67711b83-4c03-4633-b5c6-f4f5bc59ba64 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:01.264166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:01.311803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa49ba-1773-492e-bd1f-713c81b759b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:01.312450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa49ba-1773-492e-bd1f-713c81b759b9 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:01.312778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa49ba-1773-492e-bd1f-713c81b759b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:01.313007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa49ba-1773-492e-bd1f-713c81b759b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:01.314652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-83aa49ba-1773-492e-bd1f-713c81b759b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:01.425849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa49ba-1773-492e-bd1f-713c81b759b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:01.427458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa49ba-1773-492e-bd1f-713c81b759b9 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:01.449620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 693/1360] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:03.851153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc90db6-05ce-41af-98e6-039ea3f663c1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:03.851667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc90db6-05ce-41af-98e6-039ea3f663c1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:03.851667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc90db6-05ce-41af-98e6-039ea3f663c1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:03.853152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 668/1361] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:02:03.860219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a85f-c40c-4e82-b2b5-cce2d3910bbb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:03.861239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a85f-c40c-4e82-b2b5-cce2d3910bbb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:03.861239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a85f-c40c-4e82-b2b5-cce2d3910bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:03.938591 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1349a85f-c40c-4e82-b2b5-cce2d3910bbb None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:03.939789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1349a85f-c40c-4e82-b2b5-cce2d3910bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:03.982897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:04.044155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 694/1362] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:04.332643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc90db6-05ce-41af-98e6-039ea3f663c1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:04.335021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5cc90db6-05ce-41af-98e6-039ea3f663c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:04.521485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc90db6-05ce-41af-98e6-039ea3f663c1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:04.533633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:04.658635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1763043-6445-4bd0-bd78-a11126e88f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:04.659240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1763043-6445-4bd0-bd78-a11126e88f3d service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.659514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1763043-6445-4bd0-bd78-a11126e88f3d service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.659784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1763043-6445-4bd0-bd78-a11126e88f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.661403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f1763043-6445-4bd0-bd78-a11126e88f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:04.755799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1763043-6445-4bd0-bd78-a11126e88f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:04.757429 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1763043-6445-4bd0-bd78-a11126e88f3d service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:04.776278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 669/1363] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:07.395554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484280f5-ddb0-4e52-a58f-015dcc6ccde5 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.396072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484280f5-ddb0-4e52-a58f-015dcc6ccde5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.396072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484280f5-ddb0-4e52-a58f-015dcc6ccde5 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:07.397640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 695/1364] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:07.403773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed3f6-08f9-4608-9674-f9565db29e44 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.404225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed3f6-08f9-4608-9674-f9565db29e44 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.404340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ed3f6-08f9-4608-9674-f9565db29e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:07.421169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:07.495460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3d6ed3f6-08f9-4608-9674-f9565db29e44 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:07.497373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3d6ed3f6-08f9-4608-9674-f9565db29e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:07.619689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 670/1365] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:07.921480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2519cc-abc3-4191-8cfa-24432679f761 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.921773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2519cc-abc3-4191-8cfa-24432679f761 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.922038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2519cc-abc3-4191-8cfa-24432679f761 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:07.923365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 696/1366] 10.222.0.75 () {54 vars in 965 bytes} [Mon Sep 19 15:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:02:07.928789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec769e-aaea-4a0d-9aaf-131ffb1d57c7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.929274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec769e-aaea-4a0d-9aaf-131ffb1d57c7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.929559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec769e-aaea-4a0d-9aaf-131ffb1d57c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.013340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-94ec769e-aaea-4a0d-9aaf-131ffb1d57c7 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:08.014554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-94ec769e-aaea-4a0d-9aaf-131ffb1d57c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:08.050086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:08.135820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 671/1367] 10.222.0.75 () {58 vars in 1062 bytes} [Mon Sep 19 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:08.144171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2519cc-abc3-4191-8cfa-24432679f761 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.145971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dd2519cc-abc3-4191-8cfa-24432679f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:08.300084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2519cc-abc3-4191-8cfa-24432679f761 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.320808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:08.421309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de3399-10e8-4773-8d17-8ca5a13268b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.421957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de3399-10e8-4773-8d17-8ca5a13268b1 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.422196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de3399-10e8-4773-8d17-8ca5a13268b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.422443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de3399-10e8-4773-8d17-8ca5a13268b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.424028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c3de3399-10e8-4773-8d17-8ca5a13268b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:08.526235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de3399-10e8-4773-8d17-8ca5a13268b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.527831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de3399-10e8-4773-8d17-8ca5a13268b1 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.547655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 697/1368] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:08.569816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef10d-8912-4968-a876-2c6e7b223bd9 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.570292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef10d-8912-4968-a876-2c6e7b223bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.570413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef10d-8912-4968-a876-2c6e7b223bd9 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.571946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 672/1369] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:08.579084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b296-3087-405e-a31e-5586493105a7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.579539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b296-3087-405e-a31e-5586493105a7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.579883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b296-3087-405e-a31e-5586493105a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.612614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:08.647078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6468b296-3087-405e-a31e-5586493105a7 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:08.648284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6468b296-3087-405e-a31e-5586493105a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:08.754434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 698/1370] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:09.097332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d0ad-19e3-4d95-a3e5-13cbf8a1f4f6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:09.097332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d0ad-19e3-4d95-a3e5-13cbf8a1f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:09.097332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2d0ad-19e3-4d95-a3e5-13cbf8a1f4f6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:09.100076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 673/1371] 10.222.0.75 () {54 vars in 962 bytes} [Mon Sep 19 15:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:09.106239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702c6d-d3b2-41a4-9e34-d473ac0a5ece None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:09.106239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702c6d-d3b2-41a4-9e34-d473ac0a5ece None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:09.106239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702c6d-d3b2-41a4-9e34-d473ac0a5ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:09.186060 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d6702c6d-d3b2-41a4-9e34-d473ac0a5ece None None] MFA Rules not processed for user `a203084e8c5d4cb6b258b2d39db4f9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:09.187343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d6702c6d-d3b2-41a4-9e34-d473ac0a5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:09.236997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:09.271195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 699/1372] 10.222.0.75 () {58 vars in 1059 bytes} [Mon Sep 19 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:09.278375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d0ad-19e3-4d95-a3e5-13cbf8a1f4f6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:09.279982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ccf2d0ad-19e3-4d95-a3e5-13cbf8a1f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:09.397459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2d0ad-19e3-4d95-a3e5-13cbf8a1f4f6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:09.445584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:09.483117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecd1ca-2170-4676-8217-73c8788ee59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:09.483937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd1ca-2170-4676-8217-73c8788ee59d service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:09.484329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd1ca-2170-4676-8217-73c8788ee59d service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:09.484739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd1ca-2170-4676-8217-73c8788ee59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:09.486480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c8ecd1ca-2170-4676-8217-73c8788ee59d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:09.617201 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecd1ca-2170-4676-8217-73c8788ee59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:09.618668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecd1ca-2170-4676-8217-73c8788ee59d service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:09.638180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 674/1373] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:10.971153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67a5e-8127-4e7d-862f-16ddc3bada91 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:10.971965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67a5e-8127-4e7d-862f-16ddc3bada91 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:10.971965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67a5e-8127-4e7d-862f-16ddc3bada91 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:10.973357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 700/1374] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:10.980003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951af2-817e-42b7-b4c1-0c7a61dc5161 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:10.980509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951af2-817e-42b7-b4c1-0c7a61dc5161 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:10.980607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951af2-817e-42b7-b4c1-0c7a61dc5161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:11.049675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f4951af2-817e-42b7-b4c1-0c7a61dc5161 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:11.050809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f4951af2-817e-42b7-b4c1-0c7a61dc5161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:11.071779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:11.150985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 675/1375] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:11.453174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb67a5e-8127-4e7d-862f-16ddc3bada91 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:11.454909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-abb67a5e-8127-4e7d-862f-16ddc3bada91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:11.611931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb67a5e-8127-4e7d-862f-16ddc3bada91 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:11.667611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:11.738781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2e10a-db55-455e-a933-ee797c1c9208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:11.739318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e10a-db55-455e-a933-ee797c1c9208 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:11.739601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e10a-db55-455e-a933-ee797c1c9208 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:11.739901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e10a-db55-455e-a933-ee797c1c9208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:11.741873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a2f2e10a-db55-455e-a933-ee797c1c9208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:11.846011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2e10a-db55-455e-a933-ee797c1c9208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:11.847870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2e10a-db55-455e-a933-ee797c1c9208 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:11.867224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 701/1376] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:14.283181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8c71d-f58a-4e20-9941-00ac0bed70ae None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:14.283755 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8c71d-f58a-4e20-9941-00ac0bed70ae None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:14.283755 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8c71d-f58a-4e20-9941-00ac0bed70ae None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:14.285285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 676/1377] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:14.290305 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba04df-cc93-42cd-bb51-2df32ea3cc6e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:14.291199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba04df-cc93-42cd-bb51-2df32ea3cc6e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:14.291398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba04df-cc93-42cd-bb51-2df32ea3cc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:14.360927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-82ba04df-cc93-42cd-bb51-2df32ea3cc6e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:14.362237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-82ba04df-cc93-42cd-bb51-2df32ea3cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:14.369653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:14.467253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 702/1378] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:14.761315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8c71d-f58a-4e20-9941-00ac0bed70ae None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:14.764611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aec8c71d-f58a-4e20-9941-00ac0bed70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:14.917439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8c71d-f58a-4e20-9941-00ac0bed70ae None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:14.921620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:15.045440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6189aeb-9c16-4b9d-bc44-7f80929df363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:15.046148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6189aeb-9c16-4b9d-bc44-7f80929df363 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:15.046435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6189aeb-9c16-4b9d-bc44-7f80929df363 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:15.046715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6189aeb-9c16-4b9d-bc44-7f80929df363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:15.048310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c6189aeb-9c16-4b9d-bc44-7f80929df363 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:15.147761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6189aeb-9c16-4b9d-bc44-7f80929df363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:15.149664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6189aeb-9c16-4b9d-bc44-7f80929df363 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:15.170603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 677/1379] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:17.595472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63ee3-406a-4579-9538-e6a5cbad33c8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.596029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63ee3-406a-4579-9538-e6a5cbad33c8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.596029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63ee3-406a-4579-9538-e6a5cbad33c8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.597853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 703/1380] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:17.603463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d23b2-561e-433f-9aa9-306a340b58b7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.604085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d23b2-561e-433f-9aa9-306a340b58b7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.604085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d23b2-561e-433f-9aa9-306a340b58b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.615866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:17.680962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-744d23b2-561e-433f-9aa9-306a340b58b7 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:17.683104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-744d23b2-561e-433f-9aa9-306a340b58b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:17.803484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 678/1381] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:18.109427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63ee3-406a-4579-9538-e6a5cbad33c8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:18.110978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cec63ee3-406a-4579-9538-e6a5cbad33c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:18.254780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:18.265932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63ee3-406a-4579-9538-e6a5cbad33c8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:18.386883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff49528-6ef3-4a26-bbb8-e444b79245f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:18.387437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff49528-6ef3-4a26-bbb8-e444b79245f8 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:18.387715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff49528-6ef3-4a26-bbb8-e444b79245f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:18.388008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff49528-6ef3-4a26-bbb8-e444b79245f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:18.389744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ff49528-6ef3-4a26-bbb8-e444b79245f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:18.491699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff49528-6ef3-4a26-bbb8-e444b79245f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:18.494014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff49528-6ef3-4a26-bbb8-e444b79245f8 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:18.507021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:18.518450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 704/1382] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:02:21.039339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755391-0ecf-47d6-9fcc-eec4784dbd66 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:21.039998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755391-0ecf-47d6-9fcc-eec4784dbd66 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:21.039998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755391-0ecf-47d6-9fcc-eec4784dbd66 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:21.041879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 679/1383] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:21.047886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe509f2-0158-46a4-a07b-691b66ea31c0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:21.048366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe509f2-0158-46a4-a07b-691b66ea31c0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:21.048641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe509f2-0158-46a4-a07b-691b66ea31c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:21.132803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dfe509f2-0158-46a4-a07b-691b66ea31c0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:21.134588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dfe509f2-0158-46a4-a07b-691b66ea31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:21.252861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 705/1384] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:21.543016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55755391-0ecf-47d6-9fcc-eec4784dbd66 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:21.545395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-55755391-0ecf-47d6-9fcc-eec4784dbd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:21.636710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:21.699451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55755391-0ecf-47d6-9fcc-eec4784dbd66 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:21.838445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461bb5c-a348-4027-8221-851b2346af3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:21.839065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bb5c-a348-4027-8221-851b2346af3b service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:21.839352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bb5c-a348-4027-8221-851b2346af3b service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:21.839641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bb5c-a348-4027-8221-851b2346af3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:21.841344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f461bb5c-a348-4027-8221-851b2346af3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:21.893154 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:21.942155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461bb5c-a348-4027-8221-851b2346af3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:21.944190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461bb5c-a348-4027-8221-851b2346af3b service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:21.965747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 680/1385] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:24.175400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e828-a8eb-4cde-9754-7467bfced511 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.175977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e828-a8eb-4cde-9754-7467bfced511 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.175977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e828-a8eb-4cde-9754-7467bfced511 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.177548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 706/1386] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:24.182807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff56d-e91c-41e5-85ca-789ec15ea159 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.183209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff56d-e91c-41e5-85ca-789ec15ea159 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.183368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff56d-e91c-41e5-85ca-789ec15ea159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.254333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-29bff56d-e91c-41e5-85ca-789ec15ea159 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:24.255551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-29bff56d-e91c-41e5-85ca-789ec15ea159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:24.359929 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 681/1387] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:24.658525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201e828-a8eb-4cde-9754-7467bfced511 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:24.660139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e201e828-a8eb-4cde-9754-7467bfced511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:24.737322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:24.811275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201e828-a8eb-4cde-9754-7467bfced511 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.927919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fbd22-1da2-41b7-a07b-6bf687b338a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.928595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fbd22-1da2-41b7-a07b-6bf687b338a6 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.928873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fbd22-1da2-41b7-a07b-6bf687b338a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.929141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fbd22-1da2-41b7-a07b-6bf687b338a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.930743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d71fbd22-1da2-41b7-a07b-6bf687b338a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:24.969816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:25.022694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fbd22-1da2-41b7-a07b-6bf687b338a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:25.024286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fbd22-1da2-41b7-a07b-6bf687b338a6 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:25.043358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 707/1388] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:25.323577 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c2a3b-3db5-43f9-9bd4-2df15d84dabf None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:25.324161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c2a3b-3db5-43f9-9bd4-2df15d84dabf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:25.324161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c2a3b-3db5-43f9-9bd4-2df15d84dabf None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:25.325630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 682/1389] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:25.331815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3e3ad-a878-4de9-9d52-1102bd062c71 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:25.332365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3e3ad-a878-4de9-9d52-1102bd062c71 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:25.332365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3e3ad-a878-4de9-9d52-1102bd062c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:25.407658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-32f3e3ad-a878-4de9-9d52-1102bd062c71 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:25.408924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-32f3e3ad-a878-4de9-9d52-1102bd062c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:25.510537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 708/1390] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:25.817152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cf480-2a75-47c1-b1d4-7d31a4371718 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:25.817438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cf480-2a75-47c1-b1d4-7d31a4371718 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:25.817743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cf480-2a75-47c1-b1d4-7d31a4371718 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:25.819071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 683/1391] 10.222.0.75 () {54 vars in 962 bytes} [Mon Sep 19 15:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:25.824290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef194f-ece5-4515-8904-dbdfc5836afb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:25.824605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef194f-ece5-4515-8904-dbdfc5836afb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:25.824888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef194f-ece5-4515-8904-dbdfc5836afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:25.840853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:25.910649 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-21ef194f-ece5-4515-8904-dbdfc5836afb None None] MFA Rules not processed for user `aa1d30decad84c7081c7e150812b2964`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:25.911873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-21ef194f-ece5-4515-8904-dbdfc5836afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:25.999703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 709/1392] 10.222.0.75 () {58 vars in 1059 bytes} [Mon Sep 19 15:02:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:26.008865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cf480-2a75-47c1-b1d4-7d31a4371718 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:26.010638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-597cf480-2a75-47c1-b1d4-7d31a4371718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:26.043428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:26.119064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cf480-2a75-47c1-b1d4-7d31a4371718 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:26.195917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199ae88-43f2-4fcd-9542-ba6d0b580ac3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa1d30decad84c7081c7e150812b2964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:26.196586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199ae88-43f2-4fcd-9542-ba6d0b580ac3 service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:26.196872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199ae88-43f2-4fcd-9542-ba6d0b580ac3 service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:26.197239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199ae88-43f2-4fcd-9542-ba6d0b580ac3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:26.198859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4199ae88-43f2-4fcd-9542-ba6d0b580ac3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:26.283202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:26.315992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199ae88-43f2-4fcd-9542-ba6d0b580ac3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:26.321055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199ae88-43f2-4fcd-9542-ba6d0b580ac3 service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:26.336245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 684/1393] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:27.249887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24263c-044b-447a-9aad-4a21e5c10097 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:27.250369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24263c-044b-447a-9aad-4a21e5c10097 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:27.250477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24263c-044b-447a-9aad-4a21e5c10097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:27.326014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ca24263c-044b-447a-9aad-4a21e5c10097 None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:27.345497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ca24263c-044b-447a-9aad-4a21e5c10097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:27.388332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:27.418301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5a06d-3849-4238-894d-e4db0a8ba627 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:27.460639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5a06d-3849-4238-894d-e4db0a8ba627 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:27.460639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5a06d-3849-4238-894d-e4db0a8ba627 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:27.460639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 685/1394] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:02:27.464561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 710/1395] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:27.464877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522ae6-1ee8-4bb0-a62a-237231af5116 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:27.464877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522ae6-1ee8-4bb0-a62a-237231af5116 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:27.464877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522ae6-1ee8-4bb0-a62a-237231af5116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:27.473082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305435-54f4-4892-a5b9-539b5035fb8b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:27.473366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305435-54f4-4892-a5b9-539b5035fb8b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:27.473671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305435-54f4-4892-a5b9-539b5035fb8b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:27.475224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 711/1396] 10.222.0.75 () {54 vars in 943 bytes} [Mon Sep 19 15:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:02:27.482221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a0228-a1cf-4d81-86d7-7252ac1169d5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:27.482704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a0228-a1cf-4d81-86d7-7252ac1169d5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:27.483166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a0228-a1cf-4d81-86d7-7252ac1169d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:27.511802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cd522ae6-1ee8-4bb0-a62a-237231af5116 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:27.513451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cd522ae6-1ee8-4bb0-a62a-237231af5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:27.563382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-548a0228-a1cf-4d81-86d7-7252ac1169d5 None None] MFA Rules not processed for user `ad6f1167ee1d479ab3c0a5a8d46d846d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:27.564646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-548a0228-a1cf-4d81-86d7-7252ac1169d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:27.617749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 686/1397] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:27.681552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 712/1398] 10.222.0.75 () {58 vars in 1040 bytes} [Mon Sep 19 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:27.693471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522ae6-1ee8-4bb0-a62a-237231af5116 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:27.694695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cd522ae6-1ee8-4bb0-a62a-237231af5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:27.736794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:27.804603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522ae6-1ee8-4bb0-a62a-237231af5116 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:27.911119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa669ee-de83-4545-8db2-b155237db71c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:27.911742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa669ee-de83-4545-8db2-b155237db71c service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:27.912026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa669ee-de83-4545-8db2-b155237db71c service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:27.912302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa669ee-de83-4545-8db2-b155237db71c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:27.914022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eaa669ee-de83-4545-8db2-b155237db71c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:27.922117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a0228-a1cf-4d81-86d7-7252ac1169d5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:27.923377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-548a0228-a1cf-4d81-86d7-7252ac1169d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:27.957836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:27.971113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:28.001729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa669ee-de83-4545-8db2-b155237db71c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:28.008199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa669ee-de83-4545-8db2-b155237db71c service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:28.011902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 687/1399] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:02:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:02:28.028570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a0228-a1cf-4d81-86d7-7252ac1169d5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:28.144267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90489ea1-505e-4533-9b14-e5f86b899ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:28.144899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489ea1-505e-4533-9b14-e5f86b899ddd service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:28.145176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489ea1-505e-4533-9b14-e5f86b899ddd service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:28.145446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489ea1-505e-4533-9b14-e5f86b899ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:28.147072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-90489ea1-505e-4533-9b14-e5f86b899ddd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:28.189214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:28.236963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90489ea1-505e-4533-9b14-e5f86b899ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:28.238522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90489ea1-505e-4533-9b14-e5f86b899ddd service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:28.257375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 713/1400] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:02:30.641871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e9f2c-da76-4864-875f-1b1e57d51dd2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:30.642516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e9f2c-da76-4864-875f-1b1e57d51dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:30.642516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e9f2c-da76-4864-875f-1b1e57d51dd2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:30.644104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 688/1401] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:30.649447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01defd1-b857-43e4-89c1-dcf269b9684e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:30.666467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01defd1-b857-43e4-89c1-dcf269b9684e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:30.666467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01defd1-b857-43e4-89c1-dcf269b9684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:30.744246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e01defd1-b857-43e4-89c1-dcf269b9684e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:30.745652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e01defd1-b857-43e4-89c1-dcf269b9684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:30.872641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 714/1402] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:31.175196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e9f2c-da76-4864-875f-1b1e57d51dd2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:31.177010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f34e9f2c-da76-4864-875f-1b1e57d51dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:31.340587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e9f2c-da76-4864-875f-1b1e57d51dd2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:31.398681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:31.475431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e6ca7-678e-40f9-9c07-2c0c5aea137b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:31.476046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6ca7-678e-40f9-9c07-2c0c5aea137b service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:31.476330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6ca7-678e-40f9-9c07-2c0c5aea137b service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:31.476636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6ca7-678e-40f9-9c07-2c0c5aea137b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:31.478307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ec6e6ca7-678e-40f9-9c07-2c0c5aea137b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:31.582394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e6ca7-678e-40f9-9c07-2c0c5aea137b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:31.583990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e6ca7-678e-40f9-9c07-2c0c5aea137b service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:31.609022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 689/1403] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:34.032164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7e5c-fef2-40d4-b8ae-021102fc1ea5 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:34.032728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7e5c-fef2-40d4-b8ae-021102fc1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:34.034401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7e5c-fef2-40d4-b8ae-021102fc1ea5 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:34.035900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 715/1404] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:02:34.041339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd37fb-f049-434d-8cbe-6c95bb4c9734 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:34.041811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd37fb-f049-434d-8cbe-6c95bb4c9734 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:34.041915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd37fb-f049-434d-8cbe-6c95bb4c9734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:34.112818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4edd37fb-f049-434d-8cbe-6c95bb4c9734 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:34.114037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4edd37fb-f049-434d-8cbe-6c95bb4c9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:34.117336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:34.228104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 690/1405] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:34.518176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e7e5c-fef2-40d4-b8ae-021102fc1ea5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:34.520156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e72e7e5c-fef2-40d4-b8ae-021102fc1ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:34.543684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:34.692630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e7e5c-fef2-40d4-b8ae-021102fc1ea5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:34.802133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:34.825073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b98b8-adab-4da0-8cfb-a3dd9adf6930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:34.825684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b98b8-adab-4da0-8cfb-a3dd9adf6930 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:34.825955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b98b8-adab-4da0-8cfb-a3dd9adf6930 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:34.826227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b98b8-adab-4da0-8cfb-a3dd9adf6930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:34.827950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-423b98b8-adab-4da0-8cfb-a3dd9adf6930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:34.931242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b98b8-adab-4da0-8cfb-a3dd9adf6930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:34.933025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b98b8-adab-4da0-8cfb-a3dd9adf6930 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:34.952940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 716/1406] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:37.359103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a91880-8677-4b8c-9af1-868d56c6b0ff None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:37.359709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a91880-8677-4b8c-9af1-868d56c6b0ff None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:37.359709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a91880-8677-4b8c-9af1-868d56c6b0ff None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:37.361433 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 691/1407] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:37.367128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a62c-18f3-46d9-91e4-5689300010c2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:37.368153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a62c-18f3-46d9-91e4-5689300010c2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:37.368793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a62c-18f3-46d9-91e4-5689300010c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:37.441471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9962a62c-18f3-46d9-91e4-5689300010c2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:37.443008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9962a62c-18f3-46d9-91e4-5689300010c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:37.503129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:37.553469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 717/1408] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:37.852073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a91880-8677-4b8c-9af1-868d56c6b0ff None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:37.853680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d3a91880-8677-4b8c-9af1-868d56c6b0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:37.994706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:38.006056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a91880-8677-4b8c-9af1-868d56c6b0ff None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:38.134628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db836c83-feaf-428d-a679-5cdb2472c5de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:38.135312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836c83-feaf-428d-a679-5cdb2472c5de service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:38.135589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836c83-feaf-428d-a679-5cdb2472c5de service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:38.135864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db836c83-feaf-428d-a679-5cdb2472c5de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:38.137498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-db836c83-feaf-428d-a679-5cdb2472c5de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:38.233922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db836c83-feaf-428d-a679-5cdb2472c5de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:38.236403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db836c83-feaf-428d-a679-5cdb2472c5de service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:38.245807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:38.255918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 692/1409] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:47.551621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=19 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:48.278498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:52.362677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe625b-7498-4c86-ba80-1bea763a7cb6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:52.363249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe625b-7498-4c86-ba80-1bea763a7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:52.363249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe625b-7498-4c86-ba80-1bea763a7cb6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:52.364599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 718/1410] 10.222.0.75 () {54 vars in 918 bytes} [Mon Sep 19 15:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:52.370435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2207db-f778-4665-8f5e-11fee187c555 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:52.370843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2207db-f778-4665-8f5e-11fee187c555 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:52.370981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2207db-f778-4665-8f5e-11fee187c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:52.449748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-df2207db-f778-4665-8f5e-11fee187c555 None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:52.450981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df2207db-f778-4665-8f5e-11fee187c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:52.554922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 693/1411] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Sep 19 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:52.569590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc68a-6eb5-4078-8d8e-4f847b99ed04 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:52.569875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc68a-6eb5-4078-8d8e-4f847b99ed04 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:52.570150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebc68a-6eb5-4078-8d8e-4f847b99ed04 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:52.571596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 719/1412] 10.222.0.75 () {54 vars in 918 bytes} [Mon Sep 19 15:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:52.576206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba020-85dd-4ec4-8975-6cac5e111099 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:52.576560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba020-85dd-4ec4-8975-6cac5e111099 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:52.576840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba020-85dd-4ec4-8975-6cac5e111099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:52.653393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:52.656373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f0eba020-85dd-4ec4-8975-6cac5e111099 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:52.657626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f0eba020-85dd-4ec4-8975-6cac5e111099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:52.773015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 694/1413] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Sep 19 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:55.354963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874c08-f25a-440f-926c-e13d087c031d None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:55.355551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874c08-f25a-440f-926c-e13d087c031d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:55.355551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874c08-f25a-440f-926c-e13d087c031d None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:55.356944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:55.362257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d379-1f99-494d-8475-1c6748d44036 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:55.362671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d379-1f99-494d-8475-1c6748d44036 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:55.362814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d379-1f99-494d-8475-1c6748d44036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:55.434753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2273d379-1f99-494d-8475-1c6748d44036 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:55.435881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2273d379-1f99-494d-8475-1c6748d44036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:55.491187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:55.533128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:55.832666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca874c08-f25a-440f-926c-e13d087c031d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:55.832666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ca874c08-f25a-440f-926c-e13d087c031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:55.989000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca874c08-f25a-440f-926c-e13d087c031d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:56.061953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:56.101975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491a19-4d9e-4fde-bea5-7b6af5fb9b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:56.102576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491a19-4d9e-4fde-bea5-7b6af5fb9b95 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:56.102851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491a19-4d9e-4fde-bea5-7b6af5fb9b95 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:56.103120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491a19-4d9e-4fde-bea5-7b6af5fb9b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:56.104754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8c491a19-4d9e-4fde-bea5-7b6af5fb9b95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:56.194494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c491a19-4d9e-4fde-bea5-7b6af5fb9b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:56.197088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c491a19-4d9e-4fde-bea5-7b6af5fb9b95 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:56.220825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 721/1416] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:57.391874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c975c-c5b0-4434-8df2-66dec9513ee0 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:57.392435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c975c-c5b0-4434-8df2-66dec9513ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:57.392435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c975c-c5b0-4434-8df2-66dec9513ee0 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:57.393860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:57.400747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d203f-179d-4bb6-a217-0c46d9361519 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:57.401194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d203f-179d-4bb6-a217-0c46d9361519 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:57.401299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d203f-179d-4bb6-a217-0c46d9361519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:57.478542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7f1d203f-179d-4bb6-a217-0c46d9361519 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:57.479708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7f1d203f-179d-4bb6-a217-0c46d9361519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:57.506773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:57.577147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:57.730870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c975c-c5b0-4434-8df2-66dec9513ee0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:57.732371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6e5c975c-c5b0-4434-8df2-66dec9513ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:57.880950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c975c-c5b0-4434-8df2-66dec9513ee0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:57.924212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:57.997022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cdd5c-f5f9-4e40-88b8-5d93c96561fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:57.997557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cdd5c-f5f9-4e40-88b8-5d93c96561fc service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:57.997836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cdd5c-f5f9-4e40-88b8-5d93c96561fc service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:57.998145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cdd5c-f5f9-4e40-88b8-5d93c96561fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:57.999748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-424cdd5c-f5f9-4e40-88b8-5d93c96561fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:58.087015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cdd5c-f5f9-4e40-88b8-5d93c96561fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:58.088618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cdd5c-f5f9-4e40-88b8-5d93c96561fc service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:58.106293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 697/1419] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:59.239218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293585f5-d81a-434a-9139-d061a5c8285a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.239731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293585f5-d81a-434a-9139-d061a5c8285a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.239839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293585f5-d81a-434a-9139-d061a5c8285a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.241160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:02:59.248916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e432-f5a8-4183-806a-0f0f21271cc3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.249441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e432-f5a8-4183-806a-0f0f21271cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.249441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e432-f5a8-4183-806a-0f0f21271cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.305250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:59.328072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-eb04e432-f5a8-4183-806a-0f0f21271cc3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:59.329359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eb04e432-f5a8-4183-806a-0f0f21271cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:59.427612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:59.599313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293585f5-d81a-434a-9139-d061a5c8285a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:59.600870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-293585f5-d81a-434a-9139-d061a5c8285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:59.749248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293585f5-d81a-434a-9139-d061a5c8285a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:59.761722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:59.863171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a84ee-608d-4a0c-a511-5ab5911680be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:59.863796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a84ee-608d-4a0c-a511-5ab5911680be service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:59.864072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a84ee-608d-4a0c-a511-5ab5911680be service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:59.864343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a84ee-608d-4a0c-a511-5ab5911680be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:59.865966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-763a84ee-608d-4a0c-a511-5ab5911680be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:59.967477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a84ee-608d-4a0c-a511-5ab5911680be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:59.969111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a84ee-608d-4a0c-a511-5ab5911680be service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:59.987862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 724/1422] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:01.102607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832dac-8b71-4464-b323-1ab26167f29c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.103164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832dac-8b71-4464-b323-1ab26167f29c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.103397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832dac-8b71-4464-b323-1ab26167f29c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.104792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:01.111259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76e077-8a08-4589-9db0-7c2d4418b957 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.111710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76e077-8a08-4589-9db0-7c2d4418b957 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.111805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76e077-8a08-4589-9db0-7c2d4418b957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.132538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:01.189837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9c76e077-8a08-4589-9db0-7c2d4418b957 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:01.191040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9c76e077-8a08-4589-9db0-7c2d4418b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:01.286072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:01.436961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd832dac-8b71-4464-b323-1ab26167f29c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:01.438400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bd832dac-8b71-4464-b323-1ab26167f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:01.554154 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:01.591705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd832dac-8b71-4464-b323-1ab26167f29c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:01.705318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50c817-4a3d-45b3-af03-17722db0efcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:01.705851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c817-4a3d-45b3-af03-17722db0efcc service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:01.706128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c817-4a3d-45b3-af03-17722db0efcc service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:01.706396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c817-4a3d-45b3-af03-17722db0efcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:01.707983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bc50c817-4a3d-45b3-af03-17722db0efcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:01.785605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:01.799208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50c817-4a3d-45b3-af03-17722db0efcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:01.800905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50c817-4a3d-45b3-af03-17722db0efcc service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:01.818986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 700/1425] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:02.935404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecba54d-94d7-4ed9-8b43-a36c2b7489dc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:02.935940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecba54d-94d7-4ed9-8b43-a36c2b7489dc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:02.935940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecba54d-94d7-4ed9-8b43-a36c2b7489dc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:02.937332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:02.943490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a899-67ce-4faa-aa48-e3f9b12630ee None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:02.943903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a899-67ce-4faa-aa48-e3f9b12630ee None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:02.944037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a899-67ce-4faa-aa48-e3f9b12630ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.020012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4b98a899-67ce-4faa-aa48-e3f9b12630ee None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:03.021250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4b98a899-67ce-4faa-aa48-e3f9b12630ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:03.115927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:03.270576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecba54d-94d7-4ed9-8b43-a36c2b7489dc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:03.272163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5ecba54d-94d7-4ed9-8b43-a36c2b7489dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:03.358651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:03.421632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecba54d-94d7-4ed9-8b43-a36c2b7489dc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:03.535386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811cc5-b9c4-4ca5-8e6c-13d973649729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:03.535996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811cc5-b9c4-4ca5-8e6c-13d973649729 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.536277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811cc5-b9c4-4ca5-8e6c-13d973649729 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.536582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811cc5-b9c4-4ca5-8e6c-13d973649729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:03.538177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7c811cc5-b9c4-4ca5-8e6c-13d973649729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:03.596846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:03.637292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c811cc5-b9c4-4ca5-8e6c-13d973649729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:03.638907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c811cc5-b9c4-4ca5-8e6c-13d973649729 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:03.657191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 727/1428] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:04.761371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0bc2-6105-428e-bcdb-438031db11c3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:04.761907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0bc2-6105-428e-bcdb-438031db11c3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:04.761907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0bc2-6105-428e-bcdb-438031db11c3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:04.763300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:04.769413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc061-8be4-4eca-aca2-7e1b8cf06fab None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:04.769820 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc061-8be4-4eca-aca2-7e1b8cf06fab None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:04.769957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc061-8be4-4eca-aca2-7e1b8cf06fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:04.845042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1c2cc061-8be4-4eca-aca2-7e1b8cf06fab None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:04.846233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1c2cc061-8be4-4eca-aca2-7e1b8cf06fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:04.942818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:05.090708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0bc2-6105-428e-bcdb-438031db11c3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:05.092220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5e9b0bc2-6105-428e-bcdb-438031db11c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:05.142203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:05.240590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0bc2-6105-428e-bcdb-438031db11c3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:05.357911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c214c42-9755-4be1-8063-c15e29b4bb7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:05.358435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c214c42-9755-4be1-8063-c15e29b4bb7f service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.358718 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c214c42-9755-4be1-8063-c15e29b4bb7f service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.358994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c214c42-9755-4be1-8063-c15e29b4bb7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:05.360618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c214c42-9755-4be1-8063-c15e29b4bb7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:05.368186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:05.452528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c214c42-9755-4be1-8063-c15e29b4bb7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:05.454132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c214c42-9755-4be1-8063-c15e29b4bb7f service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:05.473157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 703/1431] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:06.597267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399d2b-0689-4373-8c54-76a56627468b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:06.597818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399d2b-0689-4373-8c54-76a56627468b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:06.597818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399d2b-0689-4373-8c54-76a56627468b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:06.599164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:06.606125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879e38-3a95-498d-84f8-be9e1a337349 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:06.606561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879e38-3a95-498d-84f8-be9e1a337349 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:06.606679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879e38-3a95-498d-84f8-be9e1a337349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:06.681102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d4879e38-3a95-498d-84f8-be9e1a337349 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:06.682309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d4879e38-3a95-498d-84f8-be9e1a337349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:06.749258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:06.778643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:06.931245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf399d2b-0689-4373-8c54-76a56627468b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:06.932720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bf399d2b-0689-4373-8c54-76a56627468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:06.950140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:07.078196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf399d2b-0689-4373-8c54-76a56627468b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:07.165664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:07.190853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605db9d-afff-42a8-bce4-cecb82c35ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:07.191461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605db9d-afff-42a8-bce4-cecb82c35ec0 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:07.191746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605db9d-afff-42a8-bce4-cecb82c35ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:07.192018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605db9d-afff-42a8-bce4-cecb82c35ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:07.194401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c605db9d-afff-42a8-bce4-cecb82c35ec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:07.284766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605db9d-afff-42a8-bce4-cecb82c35ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:07.286359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605db9d-afff-42a8-bce4-cecb82c35ec0 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:07.304593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 730/1434] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:08.413515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae621a-ca5f-4ba8-88ec-7cb097e9eba4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:08.414656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae621a-ca5f-4ba8-88ec-7cb097e9eba4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:08.414656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae621a-ca5f-4ba8-88ec-7cb097e9eba4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:08.416112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:08.422331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e85eae-580a-4526-8911-ed45d76ac75c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:08.422775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e85eae-580a-4526-8911-ed45d76ac75c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:08.422978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e85eae-580a-4526-8911-ed45d76ac75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:08.498351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-03e85eae-580a-4526-8911-ed45d76ac75c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:08.499551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-03e85eae-580a-4526-8911-ed45d76ac75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:08.540839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:08.595954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:08.746642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae621a-ca5f-4ba8-88ec-7cb097e9eba4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:08.748108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-36ae621a-ca5f-4ba8-88ec-7cb097e9eba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:08.893376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae621a-ca5f-4ba8-88ec-7cb097e9eba4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:08.947850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:09.006551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7708a-a8dc-4034-b1b6-24389714d1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:09.007087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7708a-a8dc-4034-b1b6-24389714d1e7 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:09.007370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7708a-a8dc-4034-b1b6-24389714d1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:09.007648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7708a-a8dc-4034-b1b6-24389714d1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:09.010167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fbe7708a-a8dc-4034-b1b6-24389714d1e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:09.099804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7708a-a8dc-4034-b1b6-24389714d1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:09.101417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7708a-a8dc-4034-b1b6-24389714d1e7 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:09.120256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 706/1437] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:10.222001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c2b0-0743-46d4-acff-58858d5e6e11 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:10.222573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c2b0-0743-46d4-acff-58858d5e6e11 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:10.222573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c2b0-0743-46d4-acff-58858d5e6e11 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:10.223881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:10.230831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15518a4b-6e88-44df-aa59-dda8658faecc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:10.231318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15518a4b-6e88-44df-aa59-dda8658faecc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:10.231419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15518a4b-6e88-44df-aa59-dda8658faecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:10.304962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-15518a4b-6e88-44df-aa59-dda8658faecc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:10.306156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-15518a4b-6e88-44df-aa59-dda8658faecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:10.308173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:10.407619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:10.556147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6c2b0-0743-46d4-acff-58858d5e6e11 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:10.557651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-54a6c2b0-0743-46d4-acff-58858d5e6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:10.701115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6c2b0-0743-46d4-acff-58858d5e6e11 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:10.728356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:10.813013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5251-94ea-424a-ae2e-33157f1e4ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:10.813621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5251-94ea-424a-ae2e-33157f1e4ffa service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:10.813894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5251-94ea-424a-ae2e-33157f1e4ffa service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:10.814161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5251-94ea-424a-ae2e-33157f1e4ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:10.815744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e10f5251-94ea-424a-ae2e-33157f1e4ffa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:10.904754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5251-94ea-424a-ae2e-33157f1e4ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:10.906349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5251-94ea-424a-ae2e-33157f1e4ffa service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:10.924319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 733/1440] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:12.997380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5c63-574a-4159-93b5-f8917b6bdf75 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:12.997949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5c63-574a-4159-93b5-f8917b6bdf75 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:12.997949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5c63-574a-4159-93b5-f8917b6bdf75 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:12.999366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:13.004540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ac6a-5da3-4b38-8fb1-1725bf55671c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:13.004946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ac6a-5da3-4b38-8fb1-1725bf55671c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:13.005087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ac6a-5da3-4b38-8fb1-1725bf55671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:13.045662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:13.069540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7fc9ac6a-5da3-4b38-8fb1-1725bf55671c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:13.071268 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7fc9ac6a-5da3-4b38-8fb1-1725bf55671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:13.165244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:13.451976 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5c63-574a-4159-93b5-f8917b6bdf75 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:13.453683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c25c5c63-574a-4159-93b5-f8917b6bdf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:13.562621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5c63-574a-4159-93b5-f8917b6bdf75 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:13.596326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:13.637654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a2c5c-ebf8-42f0-816c-fb4cb172b66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:13.638263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2c5c-ebf8-42f0-816c-fb4cb172b66a service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:13.638569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2c5c-ebf8-42f0-816c-fb4cb172b66a service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:13.639033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2c5c-ebf8-42f0-816c-fb4cb172b66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:13.641180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0a6a2c5c-ebf8-42f0-816c-fb4cb172b66a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:13.750530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a2c5c-ebf8-42f0-816c-fb4cb172b66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:13.751886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a2c5c-ebf8-42f0-816c-fb4cb172b66a service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:13.770326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 709/1443] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:16.065668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42606fd-6ea5-4149-ba8c-5b8d2f1731a6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:16.066228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42606fd-6ea5-4149-ba8c-5b8d2f1731a6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:16.066228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42606fd-6ea5-4149-ba8c-5b8d2f1731a6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:16.067556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:16.073564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dffd9d-98e2-4b04-881b-070f0f3dd61b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:16.074027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dffd9d-98e2-4b04-881b-070f0f3dd61b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:16.074136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dffd9d-98e2-4b04-881b-070f0f3dd61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:16.140913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-52dffd9d-98e2-4b04-881b-070f0f3dd61b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:16.142130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52dffd9d-98e2-4b04-881b-070f0f3dd61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:16.154772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:16.238054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:16.526774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42606fd-6ea5-4149-ba8c-5b8d2f1731a6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:16.528352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b42606fd-6ea5-4149-ba8c-5b8d2f1731a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:16.635429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42606fd-6ea5-4149-ba8c-5b8d2f1731a6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:16.648308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:16.709128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4bf09-8747-454a-834e-089bd6f9c373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:16.709735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4bf09-8747-454a-834e-089bd6f9c373 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:16.710016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4bf09-8747-454a-834e-089bd6f9c373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:16.710290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4bf09-8747-454a-834e-089bd6f9c373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:16.711973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4fb4bf09-8747-454a-834e-089bd6f9c373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:16.820838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4bf09-8747-454a-834e-089bd6f9c373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:16.822303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4bf09-8747-454a-834e-089bd6f9c373 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:16.839722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 736/1446] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:19.393656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b13a-ece9-4174-ba4c-cfc020bb4c3e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:19.394236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b13a-ece9-4174-ba4c-cfc020bb4c3e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:19.394236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b13a-ece9-4174-ba4c-cfc020bb4c3e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:19.395627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:19.401027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27877204-8f14-4be0-b75d-be189c0b683d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:19.401422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27877204-8f14-4be0-b75d-be189c0b683d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:19.401593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27877204-8f14-4be0-b75d-be189c0b683d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:19.450261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:19.467622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-27877204-8f14-4be0-b75d-be189c0b683d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:19.468874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-27877204-8f14-4be0-b75d-be189c0b683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:19.566112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:19.856001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687b13a-ece9-4174-ba4c-cfc020bb4c3e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:19.857671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f687b13a-ece9-4174-ba4c-cfc020bb4c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:19.961328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687b13a-ece9-4174-ba4c-cfc020bb4c3e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:20.001802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:20.035825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a69db-7349-43fe-8454-1c89dd2c2e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:20.036353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a69db-7349-43fe-8454-1c89dd2c2e06 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:20.036673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a69db-7349-43fe-8454-1c89dd2c2e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:20.036950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a69db-7349-43fe-8454-1c89dd2c2e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:20.040214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-881a69db-7349-43fe-8454-1c89dd2c2e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:20.149567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a69db-7349-43fe-8454-1c89dd2c2e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:20.150992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a69db-7349-43fe-8454-1c89dd2c2e06 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:20.170190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 712/1449] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:22.560043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62927-8161-486f-8add-abc299b3c15c None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:22.560639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62927-8161-486f-8add-abc299b3c15c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:22.560639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62927-8161-486f-8add-abc299b3c15c None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:22.561970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:22.567634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28d13-c8c0-438e-a40b-d62fa1df7afc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:22.568054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28d13-c8c0-438e-a40b-d62fa1df7afc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:22.568182 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28d13-c8c0-438e-a40b-d62fa1df7afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:22.635328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3ce28d13-c8c0-438e-a40b-d62fa1df7afc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:22.636549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3ce28d13-c8c0-438e-a40b-d62fa1df7afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:22.657487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:22.734296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:23.021088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62927-8161-486f-8add-abc299b3c15c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:23.022651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dca62927-8161-486f-8add-abc299b3c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:23.131178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62927-8161-486f-8add-abc299b3c15c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:23.152092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:23.205054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48db7d-939b-4720-ba68-cd9e4e8354ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:23.205692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48db7d-939b-4720-ba68-cd9e4e8354ef service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:23.205972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48db7d-939b-4720-ba68-cd9e4e8354ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:23.206247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48db7d-939b-4720-ba68-cd9e4e8354ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:23.207853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2b48db7d-939b-4720-ba68-cd9e4e8354ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:23.316270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48db7d-939b-4720-ba68-cd9e4e8354ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:23.317746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48db7d-939b-4720-ba68-cd9e4e8354ef service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:23.336755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 739/1452] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:25.556834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a368c-e2b7-4cf6-93b0-da0a8aeeca55 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:25.557347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a368c-e2b7-4cf6-93b0-da0a8aeeca55 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:25.557347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a368c-e2b7-4cf6-93b0-da0a8aeeca55 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:25.558710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:25.564038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc3e1-0765-40c7-99e4-d413fcdfaf50 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:25.564455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc3e1-0765-40c7-99e4-d413fcdfaf50 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:25.564619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc3e1-0765-40c7-99e4-d413fcdfaf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:25.628016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:25.630741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-746cc3e1-0765-40c7-99e4-d413fcdfaf50 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:25.631980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-746cc3e1-0765-40c7-99e4-d413fcdfaf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:25.731072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:26.020826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a368c-e2b7-4cf6-93b0-da0a8aeeca55 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:26.022429 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4d2a368c-e2b7-4cf6-93b0-da0a8aeeca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:26.129700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a368c-e2b7-4cf6-93b0-da0a8aeeca55 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:26.179010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:26.204042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ee4e8-3860-4bd3-9e08-0554103bc291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:26.204731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee4e8-3860-4bd3-9e08-0554103bc291 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:26.205006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee4e8-3860-4bd3-9e08-0554103bc291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:26.205278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee4e8-3860-4bd3-9e08-0554103bc291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:26.206871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-779ee4e8-3860-4bd3-9e08-0554103bc291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:26.318028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ee4e8-3860-4bd3-9e08-0554103bc291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:26.319521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ee4e8-3860-4bd3-9e08-0554103bc291 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:26.337688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 715/1455] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:28.592369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7398-9cb4-4e21-90fb-1628c2b1f0f3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:28.592942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7398-9cb4-4e21-90fb-1628c2b1f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:28.593040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7398-9cb4-4e21-90fb-1628c2b1f0f3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:28.594451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:28.600108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bacf0-d4cb-4398-8b42-a511943285af None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:28.600565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bacf0-d4cb-4398-8b42-a511943285af None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:28.600700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bacf0-d4cb-4398-8b42-a511943285af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:28.667060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7d3bacf0-d4cb-4398-8b42-a511943285af None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:28.668289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7d3bacf0-d4cb-4398-8b42-a511943285af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:28.697489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:28.765818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:29.055058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c7398-9cb4-4e21-90fb-1628c2b1f0f3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:29.056634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-822c7398-9cb4-4e21-90fb-1628c2b1f0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:29.158331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c7398-9cb4-4e21-90fb-1628c2b1f0f3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:29.187849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:29.234163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49aad1-470a-4976-a2c5-2746e60e30ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:29.234773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49aad1-470a-4976-a2c5-2746e60e30ee service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:29.235052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49aad1-470a-4976-a2c5-2746e60e30ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:29.235323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49aad1-470a-4976-a2c5-2746e60e30ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:29.236950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3a49aad1-470a-4976-a2c5-2746e60e30ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:29.347838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49aad1-470a-4976-a2c5-2746e60e30ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:29.349306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49aad1-470a-4976-a2c5-2746e60e30ee service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:29.368710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 742/1458] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:31.608461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052547be-b524-44fe-a463-d73368071242 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:31.609014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052547be-b524-44fe-a463-d73368071242 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:31.609179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052547be-b524-44fe-a463-d73368071242 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:31.610593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:31.616128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86549ae3-0f48-4cbf-baa8-08099ccdd67c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:31.616621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86549ae3-0f48-4cbf-baa8-08099ccdd67c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:31.617402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86549ae3-0f48-4cbf-baa8-08099ccdd67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:31.683299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-86549ae3-0f48-4cbf-baa8-08099ccdd67c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:31.684560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-86549ae3-0f48-4cbf-baa8-08099ccdd67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:31.692921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:31.782607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:32.068635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052547be-b524-44fe-a463-d73368071242 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:32.070191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-052547be-b524-44fe-a463-d73368071242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:32.176314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052547be-b524-44fe-a463-d73368071242 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:32.232698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:32.250908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92148304-7ca3-4f35-9c41-b27622f9f7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:32.251515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148304-7ca3-4f35-9c41-b27622f9f7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:32.251796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148304-7ca3-4f35-9c41-b27622f9f7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:32.252070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148304-7ca3-4f35-9c41-b27622f9f7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:32.254047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-92148304-7ca3-4f35-9c41-b27622f9f7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:32.362606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92148304-7ca3-4f35-9c41-b27622f9f7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:32.363969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92148304-7ca3-4f35-9c41-b27622f9f7a9 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:32.382771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 718/1461] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:34.590558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e31bc-9d83-43c5-918f-d81f821d2fe5 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:34.591134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e31bc-9d83-43c5-918f-d81f821d2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:34.591248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e31bc-9d83-43c5-918f-d81f821d2fe5 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:34.592590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:34.598283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba995-cd7c-4c79-af3e-56a553ea1cf9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:34.598730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba995-cd7c-4c79-af3e-56a553ea1cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:34.598845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba995-cd7c-4c79-af3e-56a553ea1cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:34.787215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e56ba995-cd7c-4c79-af3e-56a553ea1cf9 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:34.788971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e56ba995-cd7c-4c79-af3e-56a553ea1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:34.827801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:34.886614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:35.175400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e31bc-9d83-43c5-918f-d81f821d2fe5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:35.177021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-634e31bc-9d83-43c5-918f-d81f821d2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:35.283241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e31bc-9d83-43c5-918f-d81f821d2fe5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:35.321587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:35.357632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1243411-d7ba-4997-8b28-fcf1520a64ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:35.358241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243411-d7ba-4997-8b28-fcf1520a64ee service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:35.358723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243411-d7ba-4997-8b28-fcf1520a64ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:35.359154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243411-d7ba-4997-8b28-fcf1520a64ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:35.361122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e1243411-d7ba-4997-8b28-fcf1520a64ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:35.471603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1243411-d7ba-4997-8b28-fcf1520a64ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:35.473381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1243411-d7ba-4997-8b28-fcf1520a64ee service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:35.493811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 745/1464] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:37.670291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd134-e241-4a05-8168-fbc75943e050 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:37.670838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd134-e241-4a05-8168-fbc75943e050 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:37.670838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd134-e241-4a05-8168-fbc75943e050 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:37.672179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:37.677473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fdbd-75e4-4387-9096-d1b42bf5927e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:37.677961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fdbd-75e4-4387-9096-d1b42bf5927e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:37.678070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11fdbd-75e4-4387-9096-d1b42bf5927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:37.746969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cf11fdbd-75e4-4387-9096-d1b42bf5927e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:37.748198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cf11fdbd-75e4-4387-9096-d1b42bf5927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:37.766402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:37.845193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:38.134828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dd134-e241-4a05-8168-fbc75943e050 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:38.136407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-679dd134-e241-4a05-8168-fbc75943e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:38.244013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dd134-e241-4a05-8168-fbc75943e050 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:38.313696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:38.320636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b98b4-9fac-4e7e-95ed-dc8e28ef9640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:38.326571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b98b4-9fac-4e7e-95ed-dc8e28ef9640 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:38.326571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b98b4-9fac-4e7e-95ed-dc8e28ef9640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:38.326571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b98b4-9fac-4e7e-95ed-dc8e28ef9640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:38.326571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3f0b98b4-9fac-4e7e-95ed-dc8e28ef9640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:38.430187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b98b4-9fac-4e7e-95ed-dc8e28ef9640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:38.431507 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b98b4-9fac-4e7e-95ed-dc8e28ef9640 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:38.449609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 721/1467] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:40.679298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389b7a-2bee-4b7c-881a-d96b0362942f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:40.680018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389b7a-2bee-4b7c-881a-d96b0362942f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:40.680018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389b7a-2bee-4b7c-881a-d96b0362942f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:40.681312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:40.686726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5883ff6-ba4a-4b13-949d-1191f5a7dba8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:40.687166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5883ff6-ba4a-4b13-949d-1191f5a7dba8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:40.687298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5883ff6-ba4a-4b13-949d-1191f5a7dba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:40.753671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d5883ff6-ba4a-4b13-949d-1191f5a7dba8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:40.754877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d5883ff6-ba4a-4b13-949d-1191f5a7dba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:40.802960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:40.851351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:41.141283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c389b7a-2bee-4b7c-881a-d96b0362942f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:41.142810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6c389b7a-2bee-4b7c-881a-d96b0362942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:41.244230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c389b7a-2bee-4b7c-881a-d96b0362942f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:41.291804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:41.316910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46bb6a-5340-4e3a-b2e3-8407b8149e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:41.317509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bb6a-5340-4e3a-b2e3-8407b8149e26 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:41.317787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bb6a-5340-4e3a-b2e3-8407b8149e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:41.318055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bb6a-5340-4e3a-b2e3-8407b8149e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:41.319674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5b46bb6a-5340-4e3a-b2e3-8407b8149e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:41.426845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46bb6a-5340-4e3a-b2e3-8407b8149e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:41.428264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46bb6a-5340-4e3a-b2e3-8407b8149e26 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:41.447653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 748/1470] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:50.849616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=22 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:51.445373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=66 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:01.763787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846520-ca26-4818-b886-364995b79853 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:01.764337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846520-ca26-4818-b886-364995b79853 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:01.764337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846520-ca26-4818-b886-364995b79853 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:01.765707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 723/1471] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:04:01.770941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172ba06-86a3-479a-b999-0005e7b549bb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:01.771365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172ba06-86a3-479a-b999-0005e7b549bb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:01.771475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172ba06-86a3-479a-b999-0005e7b549bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:01.844271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0172ba06-86a3-479a-b999-0005e7b549bb None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:01.845543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0172ba06-86a3-479a-b999-0005e7b549bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:01.940190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 749/1472] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:02.255485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694ce35-6a2a-41eb-9e52-86a40d587801 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:02.255771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694ce35-6a2a-41eb-9e52-86a40d587801 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:02.256049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694ce35-6a2a-41eb-9e52-86a40d587801 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:02.258136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 724/1473] 10.222.0.75 () {54 vars in 962 bytes} [Mon Sep 19 15:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:04:02.263130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520643-4638-4db9-a820-31a2732bd36f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:02.263418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520643-4638-4db9-a820-31a2732bd36f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:02.263695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520643-4638-4db9-a820-31a2732bd36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:02.338771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6e520643-4638-4db9-a820-31a2732bd36f None None] MFA Rules not processed for user `aa1d30decad84c7081c7e150812b2964`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:02.339973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6e520643-4638-4db9-a820-31a2732bd36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:02.360957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:02.415940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 750/1474] 10.222.0.75 () {58 vars in 1059 bytes} [Mon Sep 19 15:04:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:02.423615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694ce35-6a2a-41eb-9e52-86a40d587801 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:02.425164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e694ce35-6a2a-41eb-9e52-86a40d587801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:02.529903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694ce35-6a2a-41eb-9e52-86a40d587801 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:02.603068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079dfee-f8d2-4df5-90b7-0d047d2b2ece service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa1d30decad84c7081c7e150812b2964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:02.603684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dfee-f8d2-4df5-90b7-0d047d2b2ece service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:02.603965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dfee-f8d2-4df5-90b7-0d047d2b2ece service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:02.604237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dfee-f8d2-4df5-90b7-0d047d2b2ece service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:02.605859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b079dfee-f8d2-4df5-90b7-0d047d2b2ece service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:02.659716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:02.713474 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079dfee-f8d2-4df5-90b7-0d047d2b2ece service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:02.714897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079dfee-f8d2-4df5-90b7-0d047d2b2ece service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:02.735233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 725/1475] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:05.001755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a7193-c32c-4981-94ba-5950995ae6a6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.002285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a7193-c32c-4981-94ba-5950995ae6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.002400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a7193-c32c-4981-94ba-5950995ae6a6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.003782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 751/1476] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:04:05.009295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598433c7-fcb4-4442-ad60-25ef39b7b6b7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.009679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598433c7-fcb4-4442-ad60-25ef39b7b6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.009850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598433c7-fcb4-4442-ad60-25ef39b7b6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.075800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-598433c7-fcb4-4442-ad60-25ef39b7b6b7 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:05.077015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-598433c7-fcb4-4442-ad60-25ef39b7b6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:05.173106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 726/1477] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:05.450438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a7193-c32c-4981-94ba-5950995ae6a6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:05.451906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1e1a7193-c32c-4981-94ba-5950995ae6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:05.577293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a7193-c32c-4981-94ba-5950995ae6a6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:05.627766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:05.675054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890564-5f2c-4722-abe4-d752b8098d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:05.675669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890564-5f2c-4722-abe4-d752b8098d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:05.676025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890564-5f2c-4722-abe4-d752b8098d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:05.676301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890564-5f2c-4722-abe4-d752b8098d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:05.676970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8890564-5f2c-4722-abe4-d752b8098d66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:05.679434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING py.warnings [None req-e8890564-5f2c-4722-abe4-d752b8098d66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:04:05.679434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: warnings.warn(msg) Sep 19 15:04:05.679434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: Sep 19 15:04:05.680625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8890564-5f2c-4722-abe4-d752b8098d66 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:05.700413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 752/1478] 10.222.0.75 () {56 vars in 1108 bytes} [Mon Sep 19 15:04:05 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:07.902794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc0dff-3eee-4138-8578-668997a04b5d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.903326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc0dff-3eee-4138-8578-668997a04b5d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.903326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc0dff-3eee-4138-8578-668997a04b5d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.904679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 727/1479] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:04:07.910117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb9f9-054b-45ca-84e3-6bf1713260fe None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:07.910518 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb9f9-054b-45ca-84e3-6bf1713260fe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:07.910710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb9f9-054b-45ca-84e3-6bf1713260fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:07.980704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-31beb9f9-054b-45ca-84e3-6bf1713260fe None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:07.981979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-31beb9f9-054b-45ca-84e3-6bf1713260fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:08.088528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 753/1480] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:08.383823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc0dff-3eee-4138-8578-668997a04b5d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:08.385382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1afc0dff-3eee-4138-8578-668997a04b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:08.395080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:08.530685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc0dff-3eee-4138-8578-668997a04b5d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:08.610615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:08.642917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71466934-dc62-4281-a365-f59ac7921712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:08.643474 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466934-dc62-4281-a365-f59ac7921712 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:08.643952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466934-dc62-4281-a365-f59ac7921712 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:08.644394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466934-dc62-4281-a365-f59ac7921712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:08.646444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-71466934-dc62-4281-a365-f59ac7921712 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:08.735572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71466934-dc62-4281-a365-f59ac7921712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:08.737206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71466934-dc62-4281-a365-f59ac7921712 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:08.755701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 728/1481] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:11.082018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074a01b-9526-414b-a323-50d4fe6a2bdb None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.082608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074a01b-9526-414b-a323-50d4fe6a2bdb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.082608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074a01b-9526-414b-a323-50d4fe6a2bdb None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.084008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 754/1482] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:04:11.089503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d61f3-c606-408b-abfe-2e239d3b8db7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.089944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d61f3-c606-408b-abfe-2e239d3b8db7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.090091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d61f3-c606-408b-abfe-2e239d3b8db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.156495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8b2d61f3-c606-408b-abfe-2e239d3b8db7 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:11.157685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8b2d61f3-c606-408b-abfe-2e239d3b8db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:11.203186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:11.253647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 729/1483] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:11.542847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074a01b-9526-414b-a323-50d4fe6a2bdb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:11.549497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5074a01b-9526-414b-a323-50d4fe6a2bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:11.569024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:11.648032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074a01b-9526-414b-a323-50d4fe6a2bdb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:11.721113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993120b6-2bc2-4531-ad34-a5dcfeee7ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:11.721708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993120b6-2bc2-4531-ad34-a5dcfeee7ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.722239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993120b6-2bc2-4531-ad34-a5dcfeee7ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.722514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993120b6-2bc2-4531-ad34-a5dcfeee7ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.724089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-993120b6-2bc2-4531-ad34-a5dcfeee7ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:11.914022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:11.949324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993120b6-2bc2-4531-ad34-a5dcfeee7ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:11.950807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993120b6-2bc2-4531-ad34-a5dcfeee7ce4 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:11.969975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 755/1484] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:14.189750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838dfcc-1879-4f25-ba47-f67c2eb15b82 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.190317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838dfcc-1879-4f25-ba47-f67c2eb15b82 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.190317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838dfcc-1879-4f25-ba47-f67c2eb15b82 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.191648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 730/1485] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:04:14.197558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e90119-ca14-4507-b77c-4a0d94d296e0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.197963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e90119-ca14-4507-b77c-4a0d94d296e0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.198109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e90119-ca14-4507-b77c-4a0d94d296e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.263367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-01e90119-ca14-4507-b77c-4a0d94d296e0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:14.264590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-01e90119-ca14-4507-b77c-4a0d94d296e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.362014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 756/1486] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:14.663614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838dfcc-1879-4f25-ba47-f67c2eb15b82 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.665191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a838dfcc-1879-4f25-ba47-f67c2eb15b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.767386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838dfcc-1879-4f25-ba47-f67c2eb15b82 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:14.839254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:14.840728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71c93f-962c-411f-a2b0-96e3f95cb494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:14.841329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71c93f-962c-411f-a2b0-96e3f95cb494 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.841603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71c93f-962c-411f-a2b0-96e3f95cb494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.841869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71c93f-962c-411f-a2b0-96e3f95cb494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.843434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6d71c93f-962c-411f-a2b0-96e3f95cb494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.951252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71c93f-962c-411f-a2b0-96e3f95cb494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:14.952619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71c93f-962c-411f-a2b0-96e3f95cb494 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:14.971646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 731/1487] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:17.306187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1212-f563-43aa-99d2-27b9f27c484f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.306730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1212-f563-43aa-99d2-27b9f27c484f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.306730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1212-f563-43aa-99d2-27b9f27c484f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.308065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 757/1488] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:04:17.313312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dccfe0-bf5d-4d37-a98c-6867786502f3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.313722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dccfe0-bf5d-4d37-a98c-6867786502f3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.313875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dccfe0-bf5d-4d37-a98c-6867786502f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.381869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-55dccfe0-bf5d-4d37-a98c-6867786502f3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:17.383098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-55dccfe0-bf5d-4d37-a98c-6867786502f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.434727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:17.479982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 732/1489] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:17.774180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1212-f563-43aa-99d2-27b9f27c484f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.775785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5ccd1212-f563-43aa-99d2-27b9f27c484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.811806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:17.879325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1212-f563-43aa-99d2-27b9f27c484f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.955192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccadc3c-e6d6-4b12-9775-a2a802f1ec8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.955804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccadc3c-e6d6-4b12-9775-a2a802f1ec8f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.956085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccadc3c-e6d6-4b12-9775-a2a802f1ec8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.956362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccadc3c-e6d6-4b12-9775-a2a802f1ec8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.957999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5ccadc3c-e6d6-4b12-9775-a2a802f1ec8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:18.040681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:18.069554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccadc3c-e6d6-4b12-9775-a2a802f1ec8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:18.071016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccadc3c-e6d6-4b12-9775-a2a802f1ec8f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:18.089195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 758/1490] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:04:20.724203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a4ad-aa5c-4f04-99bc-fb4eb36183af None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.725417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a4ad-aa5c-4f04-99bc-fb4eb36183af None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.725539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a4ad-aa5c-4f04-99bc-fb4eb36183af None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.726835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 733/1491] 10.222.0.75 () {54 vars in 927 bytes} [Mon Sep 19 15:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:04:20.732236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a90b3f-3494-4d29-b9d0-40411904f643 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.732681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a90b3f-3494-4d29-b9d0-40411904f643 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.732816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a90b3f-3494-4d29-b9d0-40411904f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.798657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-98a90b3f-3494-4d29-b9d0-40411904f643 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:20.799853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-98a90b3f-3494-4d29-b9d0-40411904f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:20.893448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 759/1492] 10.222.0.75 () {58 vars in 1024 bytes} [Mon Sep 19 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:21.183377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989a4ad-aa5c-4f04-99bc-fb4eb36183af None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.184948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2989a4ad-aa5c-4f04-99bc-fb4eb36183af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:21.287762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989a4ad-aa5c-4f04-99bc-fb4eb36183af None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.360699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109ad13-21b5-4016-b069-8c6d98a2a6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.361304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109ad13-21b5-4016-b069-8c6d98a2a6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.361585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109ad13-21b5-4016-b069-8c6d98a2a6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.361860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109ad13-21b5-4016-b069-8c6d98a2a6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.363446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1109ad13-21b5-4016-b069-8c6d98a2a6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:21.372640 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:21.471774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109ad13-21b5-4016-b069-8c6d98a2a6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.473408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109ad13-21b5-4016-b069-8c6d98a2a6b5 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.491698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 734/1493] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:30.891914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=82 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:31.489482 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=50 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:01.492422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7319c0c-a755-4908-a122-63e8f1165b8c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:01.493020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7319c0c-a755-4908-a122-63e8f1165b8c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:01.493020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7319c0c-a755-4908-a122-63e8f1165b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:01.589146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e7319c0c-a755-4908-a122-63e8f1165b8c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:01.590353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e7319c0c-a755-4908-a122-63e8f1165b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:01.693939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 760/1494] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:01.702619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d55b0-a16c-4191-a5fb-11ef0e9da611 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:01.703130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d55b0-a16c-4191-a5fb-11ef0e9da611 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:01.703239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d55b0-a16c-4191-a5fb-11ef0e9da611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:01.723112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-250d55b0-a16c-4191-a5fb-11ef0e9da611 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:01.724339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-250d55b0-a16c-4191-a5fb-11ef0e9da611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:01.733205 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 735/1495] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:01.737631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7319c0c-a755-4908-a122-63e8f1165b8c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:01.748063 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7319c0c-a755-4908-a122-63e8f1165b8c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:01.752797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:01.753401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:01.753678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:01.753947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:01.754602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:06:01.754904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:01.755914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING py.warnings [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:06:01.755914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: warnings.warn(msg) Sep 19 15:06:01.755914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: Sep 19 15:06:01.756829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:01.769705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 761/1496] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:06:01.778364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d55b0-a16c-4191-a5fb-11ef0e9da611 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:01.787440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d55b0-a16c-4191-a5fb-11ef0e9da611 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:01.792377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:01.793010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:01.793293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:01.793584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:01.794205 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:01.795924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING py.warnings [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:06:01.795924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: warnings.warn(msg) Sep 19 15:06:01.795924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: Sep 19 15:06:01.797164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:01.929590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 736/1497] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:01 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:01.934366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:01.944259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12b42c-13e0-44b6-9a99-f0806852591b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:01.994108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:02.001398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.005246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.005246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.005246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.005246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.005246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING py.warnings [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:06:02.005246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: warnings.warn(msg) Sep 19 15:06:02.005246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: Sep 19 15:06:02.005839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.087922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 762/1498] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:01 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:02.092066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:02.102570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d644478-c378-4b94-8c3b-353b2dd4abe9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.108057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.108692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.108975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.109250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.109982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.110989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING py.warnings [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:06:02.110989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: warnings.warn(msg) Sep 19 15:06:02.110989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: Sep 19 15:06:02.111869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.125358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 737/1499] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:02.129528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:02.139940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22415de0-681d-4920-8994-e5cbc7f9477a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.144509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123cad0-f8ca-49f6-a05a-568279ab6923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.145118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cad0-f8ca-49f6-a05a-568279ab6923 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.145395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cad0-f8ca-49f6-a05a-568279ab6923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.145665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cad0-f8ca-49f6-a05a-568279ab6923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.146298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123cad0-f8ca-49f6-a05a-568279ab6923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.147301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING py.warnings [None req-6123cad0-f8ca-49f6-a05a-568279ab6923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:06:02.147301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: warnings.warn(msg) Sep 19 15:06:02.147301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: Sep 19 15:06:02.148170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123cad0-f8ca-49f6-a05a-568279ab6923 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.162245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 763/1500] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:02.166780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:02.176585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e3d4-4a8f-4f35-8991-7dcb1c069aba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.181270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69379f52-890a-41ea-99c0-84bd2b66a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.182663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69379f52-890a-41ea-99c0-84bd2b66a74a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.182948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69379f52-890a-41ea-99c0-84bd2b66a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.183216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69379f52-890a-41ea-99c0-84bd2b66a74a admin admin] PATH_INFO: `/v3/projects/90ecb91b16dd43d18948898c5766f445/users/49760b458d6a41d0acd22b1b47b8fd7b/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.198176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69379f52-890a-41ea-99c0-84bd2b66a74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ecb91b16dd43d18948898c5766f445, user_id=49760b458d6a41d0acd22b1b47b8fd7b, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.199199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING py.warnings [None req-69379f52-890a-41ea-99c0-84bd2b66a74a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:06:02.199199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: warnings.warn(msg) Sep 19 15:06:02.199199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: Sep 19 15:06:02.201171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69379f52-890a-41ea-99c0-84bd2b66a74a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.293735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 738/1501] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:02 2022] PUT /identity/v3/projects/90ecb91b16dd43d18948898c5766f445/users/49760b458d6a41d0acd22b1b47b8fd7b/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:02.305992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5902b-cce1-4090-ac53-9bb21cc1486d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.306302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5902b-cce1-4090-ac53-9bb21cc1486d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.306619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5902b-cce1-4090-ac53-9bb21cc1486d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.334497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-60b5902b-cce1-4090-ac53-9bb21cc1486d None None] MFA Rules not processed for user `49760b458d6a41d0acd22b1b47b8fd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:02.335697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-60b5902b-cce1-4090-ac53-9bb21cc1486d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:02.399326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 764/1502] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:02.412940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611aeb9-2717-43e8-8cd2-91450d92ca9d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.413231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611aeb9-2717-43e8-8cd2-91450d92ca9d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.413536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611aeb9-2717-43e8-8cd2-91450d92ca9d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.414899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 739/1503] 10.222.0.75 () {54 vars in 962 bytes} [Mon Sep 19 15:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:06:02.420023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaf36f-cb56-4a0f-a27e-2f9a6f833af0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.420309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaf36f-cb56-4a0f-a27e-2f9a6f833af0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.420619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaf36f-cb56-4a0f-a27e-2f9a6f833af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.481409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-74aaf36f-cb56-4a0f-a27e-2f9a6f833af0 None None] MFA Rules not processed for user `a203084e8c5d4cb6b258b2d39db4f9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:02.482523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-74aaf36f-cb56-4a0f-a27e-2f9a6f833af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:02.555467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 765/1504] 10.222.0.75 () {58 vars in 1059 bytes} [Mon Sep 19 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:02.563349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611aeb9-2717-43e8-8cd2-91450d92ca9d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:02.573938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611aeb9-2717-43e8-8cd2-91450d92ca9d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.577457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ebb5d-5edf-443e-b4d8-a49c6491b04c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.578050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ebb5d-5edf-443e-b4d8-a49c6491b04c service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.578329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ebb5d-5edf-443e-b4d8-a49c6491b04c service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.578599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ebb5d-5edf-443e-b4d8-a49c6491b04c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.586672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ebb5d-5edf-443e-b4d8-a49c6491b04c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.588687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ebb5d-5edf-443e-b4d8-a49c6491b04c service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.598457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 740/1505] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:02.643477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53293c-3e7d-476f-9290-10fe551655c2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.643773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53293c-3e7d-476f-9290-10fe551655c2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.644459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53293c-3e7d-476f-9290-10fe551655c2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.645758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 766/1506] 10.222.0.75 () {52 vars in 830 bytes} [Mon Sep 19 15:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:06:02.649452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ebb5d-5edf-443e-b4d8-a49c6491b04c service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:02.710770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ebb5d-5edf-443e-b4d8-a49c6491b04c service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.716150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.716805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.717085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.717360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] PATH_INFO: `/v3/users/49760b458d6a41d0acd22b1b47b8fd7b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.718487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49760b458d6a41d0acd22b1b47b8fd7b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.719495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING py.warnings [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:06:02.719495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: warnings.warn(msg) Sep 19 15:06:02.719495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: Sep 19 15:06:02.720742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.957780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49760b458d6a41d0acd22b1b47b8fd7b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.973371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49760b458d6a41d0acd22b1b47b8fd7b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.996634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49760b458d6a41d0acd22b1b47b8fd7b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.000697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:03.123704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49760b458d6a41d0acd22b1b47b8fd7b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.124460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49760b458d6a41d0acd22b1b47b8fd7b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.130869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 741/1507] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:02 2022] DELETE /identity/v3/users/49760b458d6a41d0acd22b1b47b8fd7b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:03.136184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2d481-0b55-4601-a550-d7436b83f92b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.136490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2d481-0b55-4601-a550-d7436b83f92b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.136780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2d481-0b55-4601-a550-d7436b83f92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.156294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d7a2d481-0b55-4601-a550-d7436b83f92b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:03.157561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d7a2d481-0b55-4601-a550-d7436b83f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:03.166694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:03.216923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 767/1508] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:06:03.226763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:03.228164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:03.305709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31fad-4f4b-4da7-b218-0a1d70df26b1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:03.309926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f5d79-f4ed-451d-bee6-c94bf3c30467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:03.310538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f5d79-f4ed-451d-bee6-c94bf3c30467 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.310818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f5d79-f4ed-451d-bee6-c94bf3c30467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.311088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f5d79-f4ed-451d-bee6-c94bf3c30467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.320004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f5d79-f4ed-451d-bee6-c94bf3c30467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:03.321463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f5d79-f4ed-451d-bee6-c94bf3c30467 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:03.331373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 742/1509] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:06:03.822557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2d481-0b55-4601-a550-d7436b83f92b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:03.824034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d7a2d481-0b55-4601-a550-d7436b83f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:03.835586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2d481-0b55-4601-a550-d7436b83f92b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:03.840310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:03.840967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.841247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.841521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] PATH_INFO: `/v3/projects/90ecb91b16dd43d18948898c5766f445` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.842754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ecb91b16dd43d18948898c5766f445)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:03.843774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING py.warnings [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:06:03.843774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: warnings.warn(msg) Sep 19 15:06:03.843774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: Sep 19 15:06:03.845004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:03.964524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ecb91b16dd43d18948898c5766f445', 'request_id': 'req-0da58a69-f43c-4792-9da1-2757e6d08d85'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.970607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ecb91b16dd43d18948898c5766f445', 'request_id': 'req-0da58a69-f43c-4792-9da1-2757e6d08d85'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.986729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ecb91b16dd43d18948898c5766f445', 'request_id': 'req-0da58a69-f43c-4792-9da1-2757e6d08d85'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:04.060110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] The token cache is being invalidate because project 90ecb91b16dd43d18948898c5766f445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:04.060310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:04.061053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0da58a69-f43c-4792-9da1-2757e6d08d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:04.062561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 768/1510] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:03 2022] DELETE /identity/v3/projects/90ecb91b16dd43d18948898c5766f445 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:13.327277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:14.056686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:32.086774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943699-5b66-4b19-8f9f-10186c1f1d2d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:32.087386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943699-5b66-4b19-8f9f-10186c1f1d2d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:32.087386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943699-5b66-4b19-8f9f-10186c1f1d2d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:32.089228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:07:32.094026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f8acc-f3f9-49c7-8d80-4d8e503a5ad4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:32.094469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f8acc-f3f9-49c7-8d80-4d8e503a5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:32.094613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f8acc-f3f9-49c7-8d80-4d8e503a5ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:32.114836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0f5f8acc-f3f9-49c7-8d80-4d8e503a5ad4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:32.116044 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0f5f8acc-f3f9-49c7-8d80-4d8e503a5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:32.175132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:07:32.333271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943699-5b66-4b19-8f9f-10186c1f1d2d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:32.338416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d9943699-5b66-4b19-8f9f-10186c1f1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:32.437064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943699-5b66-4b19-8f9f-10186c1f1d2d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:32.442583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dac09-148f-4909-a15c-c37756d83c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:32.443190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dac09-148f-4909-a15c-c37756d83c1b service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:32.443468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dac09-148f-4909-a15c-c37756d83c1b service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:32.443749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dac09-148f-4909-a15c-c37756d83c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:32.453952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dac09-148f-4909-a15c-c37756d83c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:32.455527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dac09-148f-4909-a15c-c37756d83c1b service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:32.465512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 744/1513] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:33.570592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd908d6-1baa-4c25-9ce0-b512b1151bb3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:33.571165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd908d6-1baa-4c25-9ce0-b512b1151bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:33.571165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd908d6-1baa-4c25-9ce0-b512b1151bb3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:33.572545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:07:33.578776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f60769-1cd3-445f-91fe-98e429576f31 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:33.579224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f60769-1cd3-445f-91fe-98e429576f31 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:33.579343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f60769-1cd3-445f-91fe-98e429576f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:33.601484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b8f60769-1cd3-445f-91fe-98e429576f31 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:33.602607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b8f60769-1cd3-445f-91fe-98e429576f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:33.611081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:33.764921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd908d6-1baa-4c25-9ce0-b512b1151bb3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:33.779553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd908d6-1baa-4c25-9ce0-b512b1151bb3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:33.784880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c32f2-46a0-4812-a034-7f62847dca09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:33.785481 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c32f2-46a0-4812-a034-7f62847dca09 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:33.785769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c32f2-46a0-4812-a034-7f62847dca09 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:33.786043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c32f2-46a0-4812-a034-7f62847dca09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:33.794741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c32f2-46a0-4812-a034-7f62847dca09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:33.796321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c32f2-46a0-4812-a034-7f62847dca09 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:33.805605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 771/1516] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:35.589265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5985-825a-4aa0-98d3-6164e112de6e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:35.589841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5985-825a-4aa0-98d3-6164e112de6e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:35.589943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5985-825a-4aa0-98d3-6164e112de6e None None] PATH_INFO: `/v3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:35.591550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 746/1517] 10.222.0.76 () {54 vars in 925 bytes} [Mon Sep 19 15:07:35 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:07:35.598150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aa9a0-32c0-4a59-b32f-94736bc976d4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:35.598556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aa9a0-32c0-4a59-b32f-94736bc976d4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:35.598685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aa9a0-32c0-4a59-b32f-94736bc976d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:35.646621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-582aa9a0-32c0-4a59-b32f-94736bc976d4 None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:35.647820 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-582aa9a0-32c0-4a59-b32f-94736bc976d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:35.719489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 772/1518] 10.222.0.76 () {58 vars in 1015 bytes} [Mon Sep 19 15:07:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:39.605085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2ab2-fae0-4419-9c1c-7b4de948f95d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:39.605558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2ab2-fae0-4419-9c1c-7b4de948f95d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:39.605666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc2ab2-fae0-4419-9c1c-7b4de948f95d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:39.606981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 747/1519] 10.222.0.75 () {54 vars in 961 bytes} [Mon Sep 19 15:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:07:39.611875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f2feb-5146-4566-9223-9ac6eab81e37 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:39.612303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f2feb-5146-4566-9223-9ac6eab81e37 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:39.612447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f2feb-5146-4566-9223-9ac6eab81e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:39.631964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-590f2feb-5146-4566-9223-9ac6eab81e37 None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:39.633164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-590f2feb-5146-4566-9223-9ac6eab81e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:39.642136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 773/1520] 10.222.0.75 () {58 vars in 1058 bytes} [Mon Sep 19 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:07:39.649731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc2ab2-fae0-4419-9c1c-7b4de948f95d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:39.663179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc2ab2-fae0-4419-9c1c-7b4de948f95d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:39.668278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2550fae-7b71-428f-ba74-15348e4b2246 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:39.668900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550fae-7b71-428f-ba74-15348e4b2246 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:39.669199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550fae-7b71-428f-ba74-15348e4b2246 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:39.669466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550fae-7b71-428f-ba74-15348e4b2246 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:39.677552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2550fae-7b71-428f-ba74-15348e4b2246 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:39.679125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2550fae-7b71-428f-ba74-15348e4b2246 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:39.689199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 748/1521] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:07:45.307617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740466d2-72b1-4988-8ca8-6741d453b429 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:45.308224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740466d2-72b1-4988-8ca8-6741d453b429 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:45.308224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740466d2-72b1-4988-8ca8-6741d453b429 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:45.309522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:07:45.315562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ba65-c5a3-4657-b0a6-a34dacd23159 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:45.315987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ba65-c5a3-4657-b0a6-a34dacd23159 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:45.316109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ba65-c5a3-4657-b0a6-a34dacd23159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:45.339561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e661ba65-c5a3-4657-b0a6-a34dacd23159 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:45.340841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e661ba65-c5a3-4657-b0a6-a34dacd23159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:45.350854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:45.509084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740466d2-72b1-4988-8ca8-6741d453b429 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:45.523351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740466d2-72b1-4988-8ca8-6741d453b429 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:45.529767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097b0c-2a1e-47d5-9615-a8d4a1b92e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:45.533731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097b0c-2a1e-47d5-9615-a8d4a1b92e56 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:45.533731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097b0c-2a1e-47d5-9615-a8d4a1b92e56 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:45.533731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097b0c-2a1e-47d5-9615-a8d4a1b92e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:45.539247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097b0c-2a1e-47d5-9615-a8d4a1b92e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:45.540945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097b0c-2a1e-47d5-9615-a8d4a1b92e56 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:45.551274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 775/1524] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:46.619669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f5da-dce8-481c-a18c-f8a4fc4f81c2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:46.620313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f5da-dce8-481c-a18c-f8a4fc4f81c2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:46.620313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f5da-dce8-481c-a18c-f8a4fc4f81c2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:46.621677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 15:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:07:46.627783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057755d-b08c-4fec-8a66-dd5ba4bf1d31 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:46.628259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057755d-b08c-4fec-8a66-dd5ba4bf1d31 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:46.628401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057755d-b08c-4fec-8a66-dd5ba4bf1d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:46.650162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e057755d-b08c-4fec-8a66-dd5ba4bf1d31 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:46.651821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e057755d-b08c-4fec-8a66-dd5ba4bf1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:46.659908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:46.815461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f5da-dce8-481c-a18c-f8a4fc4f81c2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:46.830698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f5da-dce8-481c-a18c-f8a4fc4f81c2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:46.836133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2b4f-a245-42b1-aa04-710776426f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:46.836772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2b4f-a245-42b1-aa04-710776426f49 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:46.837063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2b4f-a245-42b1-aa04-710776426f49 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:46.837509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2b4f-a245-42b1-aa04-710776426f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:46.847340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2b4f-a245-42b1-aa04-710776426f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:46.849355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2b4f-a245-42b1-aa04-710776426f49 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:46.860148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 751/1527] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:50.966067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286e67-f6c4-4b3f-96d6-99415cd55282 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:50.966629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286e67-f6c4-4b3f-96d6-99415cd55282 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:50.966629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e286e67-f6c4-4b3f-96d6-99415cd55282 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:50.967978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:07:50.973633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecad03-41f8-4a0c-8b51-f7b8decf9d4b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:50.974073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecad03-41f8-4a0c-8b51-f7b8decf9d4b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:50.974169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecad03-41f8-4a0c-8b51-f7b8decf9d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:50.994078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a7ecad03-41f8-4a0c-8b51-f7b8decf9d4b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:50.995379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a7ecad03-41f8-4a0c-8b51-f7b8decf9d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:51.003527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:51.308712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e286e67-f6c4-4b3f-96d6-99415cd55282 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:51.310424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9e286e67-f6c4-4b3f-96d6-99415cd55282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:51.339355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:51.369336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e286e67-f6c4-4b3f-96d6-99415cd55282 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:51.372823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bd0c9-2937-4ec1-91b3-05a90aa71dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:51.373432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd0c9-2937-4ec1-91b3-05a90aa71dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:51.373717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd0c9-2937-4ec1-91b3-05a90aa71dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:51.373996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd0c9-2937-4ec1-91b3-05a90aa71dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:51.382919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bd0c9-2937-4ec1-91b3-05a90aa71dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:51.384360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bd0c9-2937-4ec1-91b3-05a90aa71dd0 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:51.394320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 778/1530] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:53.565359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00369-3f1d-47e8-9de1-fbb2366e8811 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:53.565925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00369-3f1d-47e8-9de1-fbb2366e8811 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:53.565925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00369-3f1d-47e8-9de1-fbb2366e8811 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:53.567251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:07:53.573213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015f4b-f3e8-422f-b2d8-a32abca8bf80 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:53.573721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015f4b-f3e8-422f-b2d8-a32abca8bf80 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:53.573916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015f4b-f3e8-422f-b2d8-a32abca8bf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:53.593383 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-39015f4b-f3e8-422f-b2d8-a32abca8bf80 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:53.594570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-39015f4b-f3e8-422f-b2d8-a32abca8bf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:53.602495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:53.891127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f00369-3f1d-47e8-9de1-fbb2366e8811 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:53.896496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=68 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:53.902540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f00369-3f1d-47e8-9de1-fbb2366e8811 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:53.906067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568ae79-8372-4208-b6da-9374c1ece9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:53.906667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568ae79-8372-4208-b6da-9374c1ece9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:53.906978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568ae79-8372-4208-b6da-9374c1ece9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:53.907252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568ae79-8372-4208-b6da-9374c1ece9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:53.916149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568ae79-8372-4208-b6da-9374c1ece9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:53.920900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568ae79-8372-4208-b6da-9374c1ece9b4 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:53.926786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 754/1533] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:57.523002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f55a79-21cd-4edf-b673-81bed5580a20 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:57.523570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f55a79-21cd-4edf-b673-81bed5580a20 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:57.523570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f55a79-21cd-4edf-b673-81bed5580a20 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:57.524923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:07:57.530705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a006a-b7df-493d-814d-71a394f3fce1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:57.531129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a006a-b7df-493d-814d-71a394f3fce1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:57.531262 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a006a-b7df-493d-814d-71a394f3fce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:57.550316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-929a006a-b7df-493d-814d-71a394f3fce1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:57.551512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-929a006a-b7df-493d-814d-71a394f3fce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:57.559818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:07:57.865626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f55a79-21cd-4edf-b673-81bed5580a20 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:57.867313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-06f55a79-21cd-4edf-b673-81bed5580a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:57.924371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f55a79-21cd-4edf-b673-81bed5580a20 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:57.927821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6520-56ed-4dc7-bb7e-afa8e83bdb0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:57.928418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6520-56ed-4dc7-bb7e-afa8e83bdb0c service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:57.928725 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6520-56ed-4dc7-bb7e-afa8e83bdb0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:57.929003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6520-56ed-4dc7-bb7e-afa8e83bdb0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:57.937857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a6520-56ed-4dc7-bb7e-afa8e83bdb0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:57.939278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a6520-56ed-4dc7-bb7e-afa8e83bdb0c service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:57.948876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 781/1536] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:08:00.133747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a38f0-3501-489e-987c-236abc4c223f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:08:00.134790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a38f0-3501-489e-987c-236abc4c223f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:08:00.134930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a38f0-3501-489e-987c-236abc4c223f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:08:00.136311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 15:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:08:00.141727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68da6-662c-4ed3-bec5-cb16f049c0a6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:08:00.142129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68da6-662c-4ed3-bec5-cb16f049c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:08:00.142247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68da6-662c-4ed3-bec5-cb16f049c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:08:00.162740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-12e68da6-662c-4ed3-bec5-cb16f049c0a6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:08:00.163935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-12e68da6-662c-4ed3-bec5-cb16f049c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:08:00.171737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:08:00.491102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a38f0-3501-489e-987c-236abc4c223f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:08:00.492798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e69a38f0-3501-489e-987c-236abc4c223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:08:00.506395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a38f0-3501-489e-987c-236abc4c223f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:08:00.509881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f72b7-4f75-48bb-af5c-725b5ebe9c4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:08:00.510469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f72b7-4f75-48bb-af5c-725b5ebe9c4d service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:08:00.510747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f72b7-4f75-48bb-af5c-725b5ebe9c4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:08:00.511019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f72b7-4f75-48bb-af5c-725b5ebe9c4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:08:00.519841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f72b7-4f75-48bb-af5c-725b5ebe9c4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:08:00.521264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f72b7-4f75-48bb-af5c-725b5ebe9c4d service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:08:00.531261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 757/1539] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:08:10.157097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=47 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:10.526934 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=14 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:28.845076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3bee6-b0ff-4102-94e2-7caa5ff928cf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:28.846186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3bee6-b0ff-4102-94e2-7caa5ff928cf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:28.846695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3bee6-b0ff-4102-94e2-7caa5ff928cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:28.874406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9ca3bee6-b0ff-4102-94e2-7caa5ff928cf None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:28.876147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9ca3bee6-b0ff-4102-94e2-7caa5ff928cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:28.890192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 783/1540] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:09:28.899712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cebce-7350-459a-bb42-019d4ebe6048 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:28.900294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cebce-7350-459a-bb42-019d4ebe6048 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:28.900294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cebce-7350-459a-bb42-019d4ebe6048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:28.929190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-132cebce-7350-459a-bb42-019d4ebe6048 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:28.930508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-132cebce-7350-459a-bb42-019d4ebe6048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:28.948425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 758/1541] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:28.953190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3bee6-b0ff-4102-94e2-7caa5ff928cf None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:28.964183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3bee6-b0ff-4102-94e2-7caa5ff928cf None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:28.974025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:28.974935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:28.975447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:28.976713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:28.977618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:28.978174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:28.980150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:29.004319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 784/1542] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:29.013970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cebce-7350-459a-bb42-019d4ebe6048 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:29.030382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cebce-7350-459a-bb42-019d4ebe6048 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:29.039752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60068fc7-bf27-419c-9052-932aced9258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:29.040375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068fc7-bf27-419c-9052-932aced9258a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.040680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068fc7-bf27-419c-9052-932aced9258a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.040952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068fc7-bf27-419c-9052-932aced9258a admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.041585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60068fc7-bf27-419c-9052-932aced9258a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:29.043522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60068fc7-bf27-419c-9052-932aced9258a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:29.174139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 759/1543] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:29.178628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:29.198682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f36744-8d6b-465f-af8d-9d0316711b86 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:29.291820 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe695ae-8ca7-47c3-a66a-4477b215e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:29.292866 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe695ae-8ca7-47c3-a66a-4477b215e898 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.293384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe695ae-8ca7-47c3-a66a-4477b215e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.293899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe695ae-8ca7-47c3-a66a-4477b215e898 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.294929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe695ae-8ca7-47c3-a66a-4477b215e898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:29.297424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe695ae-8ca7-47c3-a66a-4477b215e898 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:29.411088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 785/1544] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:29.416820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60068fc7-bf27-419c-9052-932aced9258a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:29.437681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60068fc7-bf27-419c-9052-932aced9258a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:29.443962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd8664-0551-4c6e-9bd0-e4cb849cf1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:29.445389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8664-0551-4c6e-9bd0-e4cb849cf1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.445761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8664-0551-4c6e-9bd0-e4cb849cf1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.448520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8664-0551-4c6e-9bd0-e4cb849cf1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.448520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd8664-0551-4c6e-9bd0-e4cb849cf1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:29.450313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd8664-0551-4c6e-9bd0-e4cb849cf1f5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:29.469570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 760/1545] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:29.474138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe695ae-8ca7-47c3-a66a-4477b215e898 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:29.492631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe695ae-8ca7-47c3-a66a-4477b215e898 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:29.500658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e029-a1ec-41fa-84f3-58bdf545dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:29.501302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e029-a1ec-41fa-84f3-58bdf545dccf admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.501589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e029-a1ec-41fa-84f3-58bdf545dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.501870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e029-a1ec-41fa-84f3-58bdf545dccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.502568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e029-a1ec-41fa-84f3-58bdf545dccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:29.504209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e029-a1ec-41fa-84f3-58bdf545dccf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:29.516628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83acba7-2567-49ce-a772-66c98af11116 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.517189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83acba7-2567-49ce-a772-66c98af11116 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.517613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83acba7-2567-49ce-a772-66c98af11116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.520661 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 786/1546] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:29.527736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e029-a1ec-41fa-84f3-58bdf545dccf admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:29.545737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e029-a1ec-41fa-84f3-58bdf545dccf admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:29.567055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06227359-7753-453b-9dd2-97c24a8e3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:29.567770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227359-7753-453b-9dd2-97c24a8e3e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.568050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227359-7753-453b-9dd2-97c24a8e3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.568326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06227359-7753-453b-9dd2-97c24a8e3e39 admin admin] PATH_INFO: `/v3/projects/8b147e8b476c4e59badeacbd573973ab/users/125691945edf41e39d74c7258d375c85/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.581681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d83acba7-2567-49ce-a772-66c98af11116 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.582927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d83acba7-2567-49ce-a772-66c98af11116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.594524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06227359-7753-453b-9dd2-97c24a8e3e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b147e8b476c4e59badeacbd573973ab, user_id=125691945edf41e39d74c7258d375c85, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:29.595741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING py.warnings [None req-06227359-7753-453b-9dd2-97c24a8e3e39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:09:29.595741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: warnings.warn(msg) Sep 19 15:09:29.595741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: Sep 19 15:09:29.598103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06227359-7753-453b-9dd2-97c24a8e3e39 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:29.617877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 761/1547] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:09:29.619237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7201bd2-18ea-46d5-834e-449516908958 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.619527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7201bd2-18ea-46d5-834e-449516908958 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.619806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7201bd2-18ea-46d5-834e-449516908958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.653510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f7201bd2-18ea-46d5-834e-449516908958 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.654724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f7201bd2-18ea-46d5-834e-449516908958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.663422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 762/1548] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.665073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2245b5-1fdc-47ea-9b48-d953e7e1dc46 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.665410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2245b5-1fdc-47ea-9b48-d953e7e1dc46 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.665852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2245b5-1fdc-47ea-9b48-d953e7e1dc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.691657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3c2245b5-1fdc-47ea-9b48-d953e7e1dc46 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.693156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3c2245b5-1fdc-47ea-9b48-d953e7e1dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.698215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 787/1549] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:29 2022] PUT /identity/v3/projects/8b147e8b476c4e59badeacbd573973ab/users/125691945edf41e39d74c7258d375c85/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:09:29.699543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f77e-8bae-441f-939c-a978efbce72e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.700072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f77e-8bae-441f-939c-a978efbce72e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.700358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f77e-8bae-441f-939c-a978efbce72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.731287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-33f7f77e-8bae-441f-939c-a978efbce72e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.737575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33f7f77e-8bae-441f-939c-a978efbce72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.765709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 763/1550] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.767719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6484c8-2c6a-42eb-875b-54f6a5317468 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.768276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6484c8-2c6a-42eb-875b-54f6a5317468 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.768773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6484c8-2c6a-42eb-875b-54f6a5317468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.795561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-be6484c8-2c6a-42eb-875b-54f6a5317468 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.797790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-be6484c8-2c6a-42eb-875b-54f6a5317468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.808131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 764/1551] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.809789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c40e3a-f3df-4db1-b3ab-204d0ecbab6e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.810132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c40e3a-f3df-4db1-b3ab-204d0ecbab6e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.810746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c40e3a-f3df-4db1-b3ab-204d0ecbab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.815893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 788/1552] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.815893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258742e0-f412-4eb4-971f-5bb446d0522e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.815893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258742e0-f412-4eb4-971f-5bb446d0522e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.815893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258742e0-f412-4eb4-971f-5bb446d0522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.833891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c4c40e3a-f3df-4db1-b3ab-204d0ecbab6e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.835157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c4c40e3a-f3df-4db1-b3ab-204d0ecbab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.842445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-258742e0-f412-4eb4-971f-5bb446d0522e None None] MFA Rules not processed for user `125691945edf41e39d74c7258d375c85`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.843612 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-258742e0-f412-4eb4-971f-5bb446d0522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.843727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 765/1553] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.845065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64a106-2fe9-480f-912c-29d9304b457b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.845285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64a106-2fe9-480f-912c-29d9304b457b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.845559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64a106-2fe9-480f-912c-29d9304b457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.865520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bc64a106-2fe9-480f-912c-29d9304b457b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.867275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bc64a106-2fe9-480f-912c-29d9304b457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.870909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:29.875281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 766/1554] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.884428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01da7a-3284-4783-93a4-581fd96934b2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.884428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01da7a-3284-4783-93a4-581fd96934b2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.884428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01da7a-3284-4783-93a4-581fd96934b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.896581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3d01da7a-3284-4783-93a4-581fd96934b2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.897843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3d01da7a-3284-4783-93a4-581fd96934b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.905871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 767/1555] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.907723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f65e8-a9f3-4d72-900a-0a2f86870f8d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.908005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f65e8-a9f3-4d72-900a-0a2f86870f8d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.908275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f65e8-a9f3-4d72-900a-0a2f86870f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.914702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 789/1556] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.918716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16066a1-41d7-4c00-96f8-dd023c51d047 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.918716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16066a1-41d7-4c00-96f8-dd023c51d047 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.918716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16066a1-41d7-4c00-96f8-dd023c51d047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.928164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e03f65e8-a9f3-4d72-900a-0a2f86870f8d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.930299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e03f65e8-a9f3-4d72-900a-0a2f86870f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.937959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b16066a1-41d7-4c00-96f8-dd023c51d047 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.942669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 768/1557] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.943610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b16066a1-41d7-4c00-96f8-dd023c51d047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.943721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fda4-5224-41d2-a5a5-c245808a2a97 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.943721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fda4-5224-41d2-a5a5-c245808a2a97 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.943721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fda4-5224-41d2-a5a5-c245808a2a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.960604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 790/1558] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.960604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16066a1-41d7-4c00-96f8-dd023c51d047 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:29.971349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16066a1-41d7-4c00-96f8-dd023c51d047 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:29.973869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1740fda4-5224-41d2-a5a5-c245808a2a97 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:29.975072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1740fda4-5224-41d2-a5a5-c245808a2a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:29.976512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307727c3-de02-41bc-841a-602d718b41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:29.977126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307727c3-de02-41bc-841a-602d718b41ba admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.977523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307727c3-de02-41bc-841a-602d718b41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.977803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307727c3-de02-41bc-841a-602d718b41ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.978456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307727c3-de02-41bc-841a-602d718b41ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:29.978763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307727c3-de02-41bc-841a-602d718b41ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:29.980394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307727c3-de02-41bc-841a-602d718b41ba admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:29.983340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 769/1559] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:29.984143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fda4-5224-41d2-a5a5-c245808a2a97 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:29.993979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 791/1560] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:29.994401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fda4-5224-41d2-a5a5-c245808a2a97 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:29.995208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfac05-5f51-44ff-b2a6-4d0f57c4a0db None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:29.995496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfac05-5f51-44ff-b2a6-4d0f57c4a0db None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:29.995769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfac05-5f51-44ff-b2a6-4d0f57c4a0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:29.999225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11edb2-c4cc-437e-b5e7-d2fc78414d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:29.999854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11edb2-c4cc-437e-b5e7-d2fc78414d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.000118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11edb2-c4cc-437e-b5e7-d2fc78414d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.000396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11edb2-c4cc-437e-b5e7-d2fc78414d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.001904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11edb2-c4cc-437e-b5e7-d2fc78414d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:30.002220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11edb2-c4cc-437e-b5e7-d2fc78414d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.003236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING py.warnings [None req-5e11edb2-c4cc-437e-b5e7-d2fc78414d1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:09:30.003236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: warnings.warn(msg) Sep 19 15:09:30.003236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: Sep 19 15:09:30.004135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11edb2-c4cc-437e-b5e7-d2fc78414d1b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.023269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 770/1561] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:30.023573 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b1dfac05-5f51-44ff-b2a6-4d0f57c4a0db None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:30.023778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a75a-f016-49b7-acad-06b3f48333f2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.023959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b1dfac05-5f51-44ff-b2a6-4d0f57c4a0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:30.024156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a75a-f016-49b7-acad-06b3f48333f2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.024156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a75a-f016-49b7-acad-06b3f48333f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.030513 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 792/1562] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:30.031442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfac05-5f51-44ff-b2a6-4d0f57c4a0db None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.041692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfac05-5f51-44ff-b2a6-4d0f57c4a0db None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.042150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-71a3a75a-f016-49b7-acad-06b3f48333f2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:30.043348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-71a3a75a-f016-49b7-acad-06b3f48333f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:30.046322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.046921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.047212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.047488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.048193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:30.048442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.050062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.051678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 771/1563] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:30.052737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00355946-f713-4713-8282-e26e636eaba2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.053020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00355946-f713-4713-8282-e26e636eaba2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.053292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00355946-f713-4713-8282-e26e636eaba2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.055216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 772/1564] 10.222.0.75 () {54 vars in 965 bytes} [Mon Sep 19 15:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:09:30.056469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4262f-0a5e-4999-9a40-8236848bf83d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.056782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4262f-0a5e-4999-9a40-8236848bf83d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.057050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4262f-0a5e-4999-9a40-8236848bf83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.071116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 793/1565] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:30.071116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.077354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-60e4262f-0a5e-4999-9a40-8236848bf83d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:30.078299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c627c2-d49b-408e-9590-92250a1caf83 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.078551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-60e4262f-0a5e-4999-9a40-8236848bf83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:30.083131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.083729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.084010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.084286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.085017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:30.085492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.086477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 773/1566] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:30.087219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4262f-0a5e-4999-9a40-8236848bf83d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.087350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.096390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4262f-0a5e-4999-9a40-8236848bf83d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.104537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 794/1567] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:30.104537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.104782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ebddc-697a-4513-957f-b34acc619ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.104782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ebddc-697a-4513-957f-b34acc619ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.104782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ebddc-697a-4513-957f-b34acc619ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.104782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ebddc-697a-4513-957f-b34acc619ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.105098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ebddc-697a-4513-957f-b34acc619ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.105186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ebddc-697a-4513-957f-b34acc619ae8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.112676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974f36a-092c-4cb7-8a96-75fa3eb347e0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.118434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.119030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.119311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.119583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.120204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.121251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING py.warnings [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:09:30.121251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: warnings.warn(msg) Sep 19 15:09:30.121251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: Sep 19 15:09:30.122434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.193798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 774/1568] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.194819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ebddc-697a-4513-957f-b34acc619ae8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.215033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:30.234223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 795/1569] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.235613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.258763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ebddc-697a-4513-957f-b34acc619ae8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.302983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06079c07-b04f-4f0d-a19f-2239b4ec63bb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.308100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217fed1-0378-499a-86ba-b7432f89adca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.308742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217fed1-0378-499a-86ba-b7432f89adca admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.309025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217fed1-0378-499a-86ba-b7432f89adca admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.309472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217fed1-0378-499a-86ba-b7432f89adca admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.310117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217fed1-0378-499a-86ba-b7432f89adca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:30.310419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217fed1-0378-499a-86ba-b7432f89adca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.312025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217fed1-0378-499a-86ba-b7432f89adca admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.317081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.317735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.317978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.318256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.318881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:30.319181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.321787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.326476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 796/1570] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:30.327999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa13a1-22ee-428a-9b9d-5bf2d63b6e11 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.328290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa13a1-22ee-428a-9b9d-5bf2d63b6e11 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.328621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa13a1-22ee-428a-9b9d-5bf2d63b6e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.333218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 775/1571] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:30.334307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.344627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26fc1e-3a66-48e8-ae90-0a732a42e512 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.349638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c383ca-bb2e-4a5d-ba38-87d20df06f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.350248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c383ca-bb2e-4a5d-ba38-87d20df06f7d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.350571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c383ca-bb2e-4a5d-ba38-87d20df06f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.350917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c383ca-bb2e-4a5d-ba38-87d20df06f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.351589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c383ca-bb2e-4a5d-ba38-87d20df06f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.353539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c383ca-bb2e-4a5d-ba38-87d20df06f7d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.368612 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f8fa13a1-22ee-428a-9b9d-5bf2d63b6e11 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:30.375043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f8fa13a1-22ee-428a-9b9d-5bf2d63b6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:30.396642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:30.435619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 797/1572] 10.222.0.75 () {58 vars in 1062 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:30.436510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa13a1-22ee-428a-9b9d-5bf2d63b6e11 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.447181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa13a1-22ee-428a-9b9d-5bf2d63b6e11 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.451709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.452296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.452611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.452882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.453524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:30.453827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.455540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.467703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 798/1573] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:30.468605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.476029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 776/1574] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.476029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c383ca-bb2e-4a5d-ba38-87d20df06f7d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.484846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e192c4-3c81-45b3-bbbd-51adf354826c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.541736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c383ca-bb2e-4a5d-ba38-87d20df06f7d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.544951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d237f-2243-4122-a237-c4d672f64dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.545568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d237f-2243-4122-a237-c4d672f64dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.545853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d237f-2243-4122-a237-c4d672f64dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.546126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d237f-2243-4122-a237-c4d672f64dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.546433 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.546757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d237f-2243-4122-a237-c4d672f64dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.547049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.547333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.547606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.548266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.548809 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d237f-2243-4122-a237-c4d672f64dfc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.549311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING py.warnings [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:09:30.549311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: warnings.warn(msg) Sep 19 15:09:30.549311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: Sep 19 15:09:30.550517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.638931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 777/1575] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.639746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.649346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a2302-8519-43a7-b19a-9ce81199b4ef admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.653963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3cf3-e9a0-479a-9452-5ff8a3cbd65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.654550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3cf3-e9a0-479a-9452-5ff8a3cbd65c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.654830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3cf3-e9a0-479a-9452-5ff8a3cbd65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.655112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3cf3-e9a0-479a-9452-5ff8a3cbd65c admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.655768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c3cf3-e9a0-479a-9452-5ff8a3cbd65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.657882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c3cf3-e9a0-479a-9452-5ff8a3cbd65c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.666167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 799/1576] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.666167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d237f-2243-4122-a237-c4d672f64dfc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.728060 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d237f-2243-4122-a237-c4d672f64dfc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.732924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0fe01-8238-4bcb-9711-6a5a07af6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.733538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fe01-8238-4bcb-9711-6a5a07af6fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.733822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fe01-8238-4bcb-9711-6a5a07af6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.734097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fe01-8238-4bcb-9711-6a5a07af6fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.734876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 778/1577] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.735002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0fe01-8238-4bcb-9711-6a5a07af6fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.735576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3cf3-e9a0-479a-9452-5ff8a3cbd65c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.736636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0fe01-8238-4bcb-9711-6a5a07af6fdd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.746332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3cf3-e9a0-479a-9452-5ff8a3cbd65c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.751861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981bd0e-fa07-4026-8384-42160fbe08bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.753107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981bd0e-fa07-4026-8384-42160fbe08bb admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.753396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981bd0e-fa07-4026-8384-42160fbe08bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.753791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981bd0e-fa07-4026-8384-42160fbe08bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.754432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981bd0e-fa07-4026-8384-42160fbe08bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.756356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981bd0e-fa07-4026-8384-42160fbe08bb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.767063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:30.816782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 800/1578] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.817620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0fe01-8238-4bcb-9711-6a5a07af6fdd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.841098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:30.846231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 779/1579] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.847127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981bd0e-fa07-4026-8384-42160fbe08bb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:30.891942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0fe01-8238-4bcb-9711-6a5a07af6fdd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.911431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981bd0e-fa07-4026-8384-42160fbe08bb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:30.916252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcf327-c007-43c6-9b81-00cc56bcb554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.916895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcf327-c007-43c6-9b81-00cc56bcb554 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.917172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcf327-c007-43c6-9b81-00cc56bcb554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.917444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcf327-c007-43c6-9b81-00cc56bcb554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.918076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcf327-c007-43c6-9b81-00cc56bcb554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:30.919979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcf327-c007-43c6-9b81-00cc56bcb554 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:30.956342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64b3ad-ac63-4ebf-88a8-86847d0989dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:30.957045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b3ad-ac63-4ebf-88a8-86847d0989dd service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:30.957318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b3ad-ac63-4ebf-88a8-86847d0989dd service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:30.957590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b3ad-ac63-4ebf-88a8-86847d0989dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:30.983006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 780/1580] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:30.987905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcf327-c007-43c6-9b81-00cc56bcb554 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.018724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64b3ad-ac63-4ebf-88a8-86847d0989dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.020324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64b3ad-ac63-4ebf-88a8-86847d0989dd service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.030373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 801/1581] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:31.031182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64b3ad-ac63-4ebf-88a8-86847d0989dd service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.042155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64b3ad-ac63-4ebf-88a8-86847d0989dd service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.046808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00d97-742d-4484-8ec5-62bd28b8aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.047395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00d97-742d-4484-8ec5-62bd28b8aa6e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.047676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00d97-742d-4484-8ec5-62bd28b8aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.047951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc00d97-742d-4484-8ec5-62bd28b8aa6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.048618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc00d97-742d-4484-8ec5-62bd28b8aa6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.049389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcf327-c007-43c6-9b81-00cc56bcb554 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.050322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc00d97-742d-4484-8ec5-62bd28b8aa6e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.054693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3767a-f9ec-4694-8363-2b8a286727be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.055373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3767a-f9ec-4694-8363-2b8a286727be admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.056295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3767a-f9ec-4694-8363-2b8a286727be admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.056717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3767a-f9ec-4694-8363-2b8a286727be admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.057424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3767a-f9ec-4694-8363-2b8a286727be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.059529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3767a-f9ec-4694-8363-2b8a286727be admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.060894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 802/1582] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.061510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00d97-742d-4484-8ec5-62bd28b8aa6e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.073061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc00d97-742d-4484-8ec5-62bd28b8aa6e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.077963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3703-7537-4bc2-9b8d-dce9ea6dd293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.086890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3703-7537-4bc2-9b8d-dce9ea6dd293 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.086890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3703-7537-4bc2-9b8d-dce9ea6dd293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.086890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3703-7537-4bc2-9b8d-dce9ea6dd293 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.086890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e3703-7537-4bc2-9b8d-dce9ea6dd293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.086890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e3703-7537-4bc2-9b8d-dce9ea6dd293 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.169285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 781/1583] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:30 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:31.170401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3767a-f9ec-4694-8363-2b8a286727be admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.180188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3767a-f9ec-4694-8363-2b8a286727be admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.184799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69995e75-42d7-44de-aca5-01adbea5767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.185412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69995e75-42d7-44de-aca5-01adbea5767e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.185701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69995e75-42d7-44de-aca5-01adbea5767e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.185979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69995e75-42d7-44de-aca5-01adbea5767e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.186612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69995e75-42d7-44de-aca5-01adbea5767e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.188205 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69995e75-42d7-44de-aca5-01adbea5767e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.201123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 803/1584] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:31 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:31.201724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 782/1585] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.201724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69995e75-42d7-44de-aca5-01adbea5767e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.202328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3703-7537-4bc2-9b8d-dce9ea6dd293 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.211784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69995e75-42d7-44de-aca5-01adbea5767e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.216507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3703-7537-4bc2-9b8d-dce9ea6dd293 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.216850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04441db-1814-415a-ab54-5c73c1c553fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.217448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04441db-1814-415a-ab54-5c73c1c553fd admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.217732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04441db-1814-415a-ab54-5c73c1c553fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.218007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04441db-1814-415a-ab54-5c73c1c553fd admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.218633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04441db-1814-415a-ab54-5c73c1c553fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.220658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04441db-1814-415a-ab54-5c73c1c553fd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.221680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60aec-c8fa-48df-bd9e-d3522ba25e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.222345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60aec-c8fa-48df-bd9e-d3522ba25e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.222947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60aec-c8fa-48df-bd9e-d3522ba25e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.223281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60aec-c8fa-48df-bd9e-d3522ba25e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.223996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d60aec-c8fa-48df-bd9e-d3522ba25e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.225978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d60aec-c8fa-48df-bd9e-d3522ba25e7b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.319437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 783/1586] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:31 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:31.319437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04441db-1814-415a-ab54-5c73c1c553fd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.325918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 804/1587] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:31 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:31.326885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60aec-c8fa-48df-bd9e-d3522ba25e7b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.330392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04441db-1814-415a-ab54-5c73c1c553fd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.335200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421560d0-097e-4746-8419-97117c76bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.335805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421560d0-097e-4746-8419-97117c76bb13 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.336786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421560d0-097e-4746-8419-97117c76bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.337076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421560d0-097e-4746-8419-97117c76bb13 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.337455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60aec-c8fa-48df-bd9e-d3522ba25e7b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.337808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421560d0-097e-4746-8419-97117c76bb13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.339796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421560d0-097e-4746-8419-97117c76bb13 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.342085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead36fbf-4099-49f5-8de6-0a2a19f6b625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.345564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36fbf-4099-49f5-8de6-0a2a19f6b625 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.345564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36fbf-4099-49f5-8de6-0a2a19f6b625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.345564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36fbf-4099-49f5-8de6-0a2a19f6b625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.345564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead36fbf-4099-49f5-8de6-0a2a19f6b625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.346942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead36fbf-4099-49f5-8de6-0a2a19f6b625 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.348979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:31.358047 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 805/1588] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.358849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead36fbf-4099-49f5-8de6-0a2a19f6b625 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.368159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead36fbf-4099-49f5-8de6-0a2a19f6b625 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.372819 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790645e-3ead-476b-8118-23049ffed3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.373387 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790645e-3ead-476b-8118-23049ffed3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.373704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790645e-3ead-476b-8118-23049ffed3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.374016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790645e-3ead-476b-8118-23049ffed3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.374639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790645e-3ead-476b-8118-23049ffed3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.376204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790645e-3ead-476b-8118-23049ffed3e3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.385983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 806/1589] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.386743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790645e-3ead-476b-8118-23049ffed3e3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.396308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790645e-3ead-476b-8118-23049ffed3e3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.406721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3439c-a249-4b7a-bc07-e17701fe018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.406721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3439c-a249-4b7a-bc07-e17701fe018a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.406721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3439c-a249-4b7a-bc07-e17701fe018a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.406721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3439c-a249-4b7a-bc07-e17701fe018a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.407968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3439c-a249-4b7a-bc07-e17701fe018a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.407968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3439c-a249-4b7a-bc07-e17701fe018a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.418972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 807/1590] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.418972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3439c-a249-4b7a-bc07-e17701fe018a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.425883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3439c-a249-4b7a-bc07-e17701fe018a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.431405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94780a39-4697-4421-87d2-dc61f9ffeeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.431971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94780a39-4697-4421-87d2-dc61f9ffeeaf admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.432248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94780a39-4697-4421-87d2-dc61f9ffeeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.432548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94780a39-4697-4421-87d2-dc61f9ffeeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.433168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94780a39-4697-4421-87d2-dc61f9ffeeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.434721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94780a39-4697-4421-87d2-dc61f9ffeeaf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.438649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 784/1591] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:31 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:31.440048 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce54c-d639-47b6-9950-66886da07daa None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.440369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce54c-d639-47b6-9950-66886da07daa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.440690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce54c-d639-47b6-9950-66886da07daa None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.442303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 785/1592] 10.222.0.75 () {54 vars in 912 bytes} [Mon Sep 19 15:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:09:31.443016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ce54c-d639-47b6-9950-66886da07daa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.449679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 808/1593] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.449679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94780a39-4697-4421-87d2-dc61f9ffeeaf admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.456165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ce54c-d639-47b6-9950-66886da07daa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.457587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94780a39-4697-4421-87d2-dc61f9ffeeaf admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.460723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaad16-3f69-462a-a184-7596177c548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.462081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaad16-3f69-462a-a184-7596177c548c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.462365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaad16-3f69-462a-a184-7596177c548c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.462642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaad16-3f69-462a-a184-7596177c548c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.463073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983609e-cc05-450c-830c-40b92453f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.463285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaad16-3f69-462a-a184-7596177c548c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.463663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983609e-cc05-450c-830c-40b92453f6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.463944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983609e-cc05-450c-830c-40b92453f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.464217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983609e-cc05-450c-830c-40b92453f6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.464885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983609e-cc05-450c-830c-40b92453f6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.468149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaad16-3f69-462a-a184-7596177c548c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.468261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983609e-cc05-450c-830c-40b92453f6c2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.476047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 786/1594] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.480597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaad16-3f69-462a-a184-7596177c548c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.480735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 809/1595] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.480735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983609e-cc05-450c-830c-40b92453f6c2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.489922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983609e-cc05-450c-830c-40b92453f6c2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.490717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaad16-3f69-462a-a184-7596177c548c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.494786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439205c-6514-4b8f-9b1c-bb69a7206506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.495405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439205c-6514-4b8f-9b1c-bb69a7206506 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.495544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a288e92-679c-4d78-bc57-c9824fc8a295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.495652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439205c-6514-4b8f-9b1c-bb69a7206506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.495933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439205c-6514-4b8f-9b1c-bb69a7206506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.496307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288e92-679c-4d78-bc57-c9824fc8a295 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.496436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288e92-679c-4d78-bc57-c9824fc8a295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.496620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439205c-6514-4b8f-9b1c-bb69a7206506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.496715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288e92-679c-4d78-bc57-c9824fc8a295 admin admin] PATH_INFO: `/v3/projects/c727384d4ff043809f8421840cbd7596/users/833edf46ef9b4d3982ce49abc74933a2/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.498199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439205c-6514-4b8f-9b1c-bb69a7206506 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.499005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:31.510377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 810/1596] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.511403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439205c-6514-4b8f-9b1c-bb69a7206506 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.513441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a288e92-679c-4d78-bc57-c9824fc8a295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c727384d4ff043809f8421840cbd7596, user_id=833edf46ef9b4d3982ce49abc74933a2, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.516118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a288e92-679c-4d78-bc57-c9824fc8a295 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.524131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439205c-6514-4b8f-9b1c-bb69a7206506 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.528807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc402fb1-2b65-48be-94ad-55ec4be6d168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.533012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc402fb1-2b65-48be-94ad-55ec4be6d168 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.533012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc402fb1-2b65-48be-94ad-55ec4be6d168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.533012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc402fb1-2b65-48be-94ad-55ec4be6d168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.533012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc402fb1-2b65-48be-94ad-55ec4be6d168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.533012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc402fb1-2b65-48be-94ad-55ec4be6d168 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.542223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 811/1597] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.543151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc402fb1-2b65-48be-94ad-55ec4be6d168 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.552458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc402fb1-2b65-48be-94ad-55ec4be6d168 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.557765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fdd15-c068-480a-aaad-ada5de07b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.559932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdd15-c068-480a-aaad-ada5de07b88d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.559932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdd15-c068-480a-aaad-ada5de07b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.559932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdd15-c068-480a-aaad-ada5de07b88d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.559932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fdd15-c068-480a-aaad-ada5de07b88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.561075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fdd15-c068-480a-aaad-ada5de07b88d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.571359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 812/1598] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.574490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7895-4fd1-4355-96ba-86a2aeb97f94 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.574490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7895-4fd1-4355-96ba-86a2aeb97f94 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.574490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7895-4fd1-4355-96ba-86a2aeb97f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.585401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 787/1599] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:31 2022] PUT /identity/v3/projects/c727384d4ff043809f8421840cbd7596/users/833edf46ef9b4d3982ce49abc74933a2/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:31.586483 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a288e92-679c-4d78-bc57-c9824fc8a295 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.593371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-554a7895-4fd1-4355-96ba-86a2aeb97f94 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:31.594720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-554a7895-4fd1-4355-96ba-86a2aeb97f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:31.649829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a288e92-679c-4d78-bc57-c9824fc8a295 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.656080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068253-a38c-4b61-8127-8c377118f1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.656794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068253-a38c-4b61-8127-8c377118f1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.657082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068253-a38c-4b61-8127-8c377118f1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.657363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068253-a38c-4b61-8127-8c377118f1a7 admin admin] PATH_INFO: `/v3/projects/5bc82dc1b38c47a6ba15c2b37684229d/users/3d301818367c472b963fe9d5bbadfa8f/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.671396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 813/1600] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:31.671396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a7895-4fd1-4355-96ba-86a2aeb97f94 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.676566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1068253-a38c-4b61-8127-8c377118f1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc82dc1b38c47a6ba15c2b37684229d, user_id=3d301818367c472b963fe9d5bbadfa8f, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.680463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1068253-a38c-4b61-8127-8c377118f1a7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.686959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a7895-4fd1-4355-96ba-86a2aeb97f94 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.691601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f573-0ea6-4dc9-b018-90e0a50dd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.693512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f573-0ea6-4dc9-b018-90e0a50dd0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.693512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f573-0ea6-4dc9-b018-90e0a50dd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.693512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f573-0ea6-4dc9-b018-90e0a50dd0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.693512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773f573-0ea6-4dc9-b018-90e0a50dd0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.695018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773f573-0ea6-4dc9-b018-90e0a50dd0d0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.705471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 814/1601] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.708732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f573-0ea6-4dc9-b018-90e0a50dd0d0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.715785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f573-0ea6-4dc9-b018-90e0a50dd0d0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.721898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432277fb-0b81-458d-8de3-b77d72acf80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.721898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432277fb-0b81-458d-8de3-b77d72acf80e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.721898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432277fb-0b81-458d-8de3-b77d72acf80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.721898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432277fb-0b81-458d-8de3-b77d72acf80e admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.722315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432277fb-0b81-458d-8de3-b77d72acf80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.724028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432277fb-0b81-458d-8de3-b77d72acf80e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.734475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 815/1602] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:31.735362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432277fb-0b81-458d-8de3-b77d72acf80e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.746090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432277fb-0b81-458d-8de3-b77d72acf80e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.748512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 788/1603] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:31 2022] PUT /identity/v3/projects/5bc82dc1b38c47a6ba15c2b37684229d/users/3d301818367c472b963fe9d5bbadfa8f/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:31.751317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068253-a38c-4b61-8127-8c377118f1a7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.795223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:31.806197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5a76a-fddf-463b-acd6-a9babc8a75ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.806890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a76a-fddf-463b-acd6-a9babc8a75ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.807192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a76a-fddf-463b-acd6-a9babc8a75ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.807495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5a76a-fddf-463b-acd6-a9babc8a75ed admin admin] PATH_INFO: `/v3/projects/80f8731fe34a41ce9ec7b0cf105d6135/users/4b1cafa99cb14c2697b38806c69be811/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.823641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5a76a-fddf-463b-acd6-a9babc8a75ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f8731fe34a41ce9ec7b0cf105d6135, user_id=4b1cafa99cb14c2697b38806c69be811, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.826255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068253-a38c-4b61-8127-8c377118f1a7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:31.826512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5a76a-fddf-463b-acd6-a9babc8a75ed admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.831054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2865d-0e56-436d-b4ba-cc8163f0625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:31.831720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2865d-0e56-436d-b4ba-cc8163f0625b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.831998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2865d-0e56-436d-b4ba-cc8163f0625b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.832274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2865d-0e56-436d-b4ba-cc8163f0625b admin admin] PATH_INFO: `/v3/projects/ef0871bc1c2b4276afb1d8ad77fda839/users/6452ad1301fb4f2aa2f0c015463455c4/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.847362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2865d-0e56-436d-b4ba-cc8163f0625b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0871bc1c2b4276afb1d8ad77fda839, user_id=6452ad1301fb4f2aa2f0c015463455c4, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:31.850335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2865d-0e56-436d-b4ba-cc8163f0625b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:31.912533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 816/1604] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:31 2022] PUT /identity/v3/projects/80f8731fe34a41ce9ec7b0cf105d6135/users/4b1cafa99cb14c2697b38806c69be811/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:31.913515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5a76a-fddf-463b-acd6-a9babc8a75ed admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:31.936172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 789/1605] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:31 2022] PUT /identity/v3/projects/ef0871bc1c2b4276afb1d8ad77fda839/users/6452ad1301fb4f2aa2f0c015463455c4/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:31.937404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df998812-1bb1-4f6a-a162-02d04e8038f1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:31.937688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df998812-1bb1-4f6a-a162-02d04e8038f1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:31.937965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df998812-1bb1-4f6a-a162-02d04e8038f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:31.957119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-df998812-1bb1-4f6a-a162-02d04e8038f1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:31.963373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df998812-1bb1-4f6a-a162-02d04e8038f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:31.977905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5a76a-fddf-463b-acd6-a9babc8a75ed admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.005603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:32.021078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 790/1606] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:32.022055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df998812-1bb1-4f6a-a162-02d04e8038f1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.038248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470167-800d-41ad-8ef1-87dad546978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.038861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470167-800d-41ad-8ef1-87dad546978d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.039284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470167-800d-41ad-8ef1-87dad546978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.039569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470167-800d-41ad-8ef1-87dad546978d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.040554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470167-800d-41ad-8ef1-87dad546978d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.054235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470167-800d-41ad-8ef1-87dad546978d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.054235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 817/1607] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:32.054235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470167-800d-41ad-8ef1-87dad546978d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.062964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470167-800d-41ad-8ef1-87dad546978d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.067550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e0e6-2936-48e1-9fb5-ae8d2f88ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.068183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e0e6-2936-48e1-9fb5-ae8d2f88ed1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.068462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e0e6-2936-48e1-9fb5-ae8d2f88ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.068764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e0e6-2936-48e1-9fb5-ae8d2f88ed1a admin admin] PATH_INFO: `/v3/projects/13d5af34cdc54fd8be3b076c629e2cbd/users/fb7200a9769b46b3a79c9fe6287a1724/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.078951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df998812-1bb1-4f6a-a162-02d04e8038f1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.082951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec62f8e-345d-4aa7-b5a5-48971b5ced61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.083565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec62f8e-345d-4aa7-b5a5-48971b5ced61 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.083842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec62f8e-345d-4aa7-b5a5-48971b5ced61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.083956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743e0e6-2936-48e1-9fb5-ae8d2f88ed1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d5af34cdc54fd8be3b076c629e2cbd, user_id=fb7200a9769b46b3a79c9fe6287a1724, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.084114 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec62f8e-345d-4aa7-b5a5-48971b5ced61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.087309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743e0e6-2936-48e1-9fb5-ae8d2f88ed1a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.152379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 818/1608] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:32 2022] PUT /identity/v3/projects/13d5af34cdc54fd8be3b076c629e2cbd/users/fb7200a9769b46b3a79c9fe6287a1724/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:32.153372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e0e6-2936-48e1-9fb5-ae8d2f88ed1a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.153622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec62f8e-345d-4aa7-b5a5-48971b5ced61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.155196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec62f8e-345d-4aa7-b5a5-48971b5ced61 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.167443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 791/1609] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:32.170668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046c79-df04-42b3-a1cf-a669c1394781 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.171023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046c79-df04-42b3-a1cf-a669c1394781 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.171358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046c79-df04-42b3-a1cf-a669c1394781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.202126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-04046c79-df04-42b3-a1cf-a669c1394781 None None] MFA Rules not processed for user `3d301818367c472b963fe9d5bbadfa8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:32.203556 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-04046c79-df04-42b3-a1cf-a669c1394781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:32.210120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:32.224241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e0e6-2936-48e1-9fb5-ae8d2f88ed1a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.229729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f88c7-36ca-4808-8ef5-e1a88897ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.230404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f88c7-36ca-4808-8ef5-e1a88897ee5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.230685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f88c7-36ca-4808-8ef5-e1a88897ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.230966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f88c7-36ca-4808-8ef5-e1a88897ee5d admin admin] PATH_INFO: `/v3/projects/4a7b06a30986458abf143c857dc5524f/users/be8107ba4aa844acae23c46773ad9620/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.246961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f88c7-36ca-4808-8ef5-e1a88897ee5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7b06a30986458abf143c857dc5524f, user_id=be8107ba4aa844acae23c46773ad9620, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.249737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f88c7-36ca-4808-8ef5-e1a88897ee5d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.274042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 792/1610] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:32.275330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457864d-cc91-4bd5-a504-6958a2e51305 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.275667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457864d-cc91-4bd5-a504-6958a2e51305 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.275988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457864d-cc91-4bd5-a504-6958a2e51305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.295476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1457864d-cc91-4bd5-a504-6958a2e51305 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:32.296735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1457864d-cc91-4bd5-a504-6958a2e51305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:32.304522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 793/1611] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:32.305693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ae2-b501-4a46-94cc-d83371b0933f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.305979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ae2-b501-4a46-94cc-d83371b0933f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.306248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ae2-b501-4a46-94cc-d83371b0933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.324720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-710b5ae2-b501-4a46-94cc-d83371b0933f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:32.325959 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-710b5ae2-b501-4a46-94cc-d83371b0933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:32.333532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 794/1612] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:32.334299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5ae2-b501-4a46-94cc-d83371b0933f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.344719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:32.351599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 819/1613] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:32 2022] PUT /identity/v3/projects/4a7b06a30986458abf143c857dc5524f/users/be8107ba4aa844acae23c46773ad9620/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:32.353510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f88c7-36ca-4808-8ef5-e1a88897ee5d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.407223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5ae2-b501-4a46-94cc-d83371b0933f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.427011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f88c7-36ca-4808-8ef5-e1a88897ee5d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.433806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258a13-d039-437d-8637-451b765ddfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.434474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258a13-d039-437d-8637-451b765ddfd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.434756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258a13-d039-437d-8637-451b765ddfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.435033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258a13-d039-437d-8637-451b765ddfd6 admin admin] PATH_INFO: `/v3/projects/e4de2627ff884f9f9afd68edb0dadf26/users/808156c7457b4e8b9b6c5f305755b3f3/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.451332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76258a13-d039-437d-8637-451b765ddfd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4de2627ff884f9f9afd68edb0dadf26, user_id=808156c7457b4e8b9b6c5f305755b3f3, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.453964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76258a13-d039-437d-8637-451b765ddfd6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.463308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617c895-1906-425d-b526-aaeb195d255c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.463955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617c895-1906-425d-b526-aaeb195d255c service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.464241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617c895-1906-425d-b526-aaeb195d255c service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.464696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617c895-1906-425d-b526-aaeb195d255c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.474371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617c895-1906-425d-b526-aaeb195d255c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.475826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617c895-1906-425d-b526-aaeb195d255c service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.485617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 795/1614] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:32.486630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48ff2-8bbb-42ea-affa-dd9f0ea9be81 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.486915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48ff2-8bbb-42ea-affa-dd9f0ea9be81 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.487190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b48ff2-8bbb-42ea-affa-dd9f0ea9be81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.506847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c0b48ff2-8bbb-42ea-affa-dd9f0ea9be81 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:32.509052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c0b48ff2-8bbb-42ea-affa-dd9f0ea9be81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:32.516866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 796/1615] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:32.517891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b48ff2-8bbb-42ea-affa-dd9f0ea9be81 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.528358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b48ff2-8bbb-42ea-affa-dd9f0ea9be81 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.536177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 820/1616] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:32 2022] PUT /identity/v3/projects/e4de2627ff884f9f9afd68edb0dadf26/users/808156c7457b4e8b9b6c5f305755b3f3/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:32.537798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258a13-d039-437d-8637-451b765ddfd6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.601217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad3680-d75d-4612-a356-77a232d57ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.602148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3680-d75d-4612-a356-77a232d57ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.602418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3680-d75d-4612-a356-77a232d57ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.602691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3680-d75d-4612-a356-77a232d57ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.603323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad3680-d75d-4612-a356-77a232d57ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.605251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad3680-d75d-4612-a356-77a232d57ecd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.612185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258a13-d039-437d-8637-451b765ddfd6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.617850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.617850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.617850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.617850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.628393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.630014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.641074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 821/1617] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:32.641754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.643092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:32.655269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a3479-1f43-45d5-88b6-38690c1b79b7 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.660415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5ac3a-ac91-4cc2-bbb3-091acf43167f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.661299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5ac3a-ac91-4cc2-bbb3-091acf43167f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.661299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5ac3a-ac91-4cc2-bbb3-091acf43167f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.661647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5ac3a-ac91-4cc2-bbb3-091acf43167f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.671940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5ac3a-ac91-4cc2-bbb3-091acf43167f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.673524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5ac3a-ac91-4cc2-bbb3-091acf43167f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.694806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 797/1618] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:32.694806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a778312-1208-49e6-8de8-730c6902fccb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.694806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a778312-1208-49e6-8de8-730c6902fccb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.694806 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a778312-1208-49e6-8de8-730c6902fccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.696013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 822/1619] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:32.697936 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5ac3a-ac91-4cc2-bbb3-091acf43167f service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.711934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5ac3a-ac91-4cc2-bbb3-091acf43167f service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.738381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2a778312-1208-49e6-8de8-730c6902fccb None None] MFA Rules not processed for user `be8107ba4aa844acae23c46773ad9620`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:32.739704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2a778312-1208-49e6-8de8-730c6902fccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:32.769620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:32.775030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2aead-21b0-4895-b761-b4d51b51f315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.775663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2aead-21b0-4895-b761-b4d51b51f315 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.775952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2aead-21b0-4895-b761-b4d51b51f315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.776228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2aead-21b0-4895-b761-b4d51b51f315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.790261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:32.854267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 798/1620] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:32.856975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9444c-37d0-42e4-a3f0-e02025e5b3d4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.858021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9444c-37d0-42e4-a3f0-e02025e5b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.858562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9444c-37d0-42e4-a3f0-e02025e5b3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.876943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2aead-21b0-4895-b761-b4d51b51f315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.881050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2aead-21b0-4895-b761-b4d51b51f315 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.894948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9ee9444c-37d0-42e4-a3f0-e02025e5b3d4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:32.895652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 823/1621] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:32.896506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9ee9444c-37d0-42e4-a3f0-e02025e5b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:32.896629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2aead-21b0-4895-b761-b4d51b51f315 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.906460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 799/1622] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:32.908007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9444c-37d0-42e4-a3f0-e02025e5b3d4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:32.926749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2aead-21b0-4895-b761-b4d51b51f315 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.932108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9444c-37d0-42e4-a3f0-e02025e5b3d4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:32.932754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa50dc9-9643-426e-9edf-94450e38d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.933386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa50dc9-9643-426e-9edf-94450e38d45b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.933677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa50dc9-9643-426e-9edf-94450e38d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.933958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa50dc9-9643-426e-9edf-94450e38d45b admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.934598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa50dc9-9643-426e-9edf-94450e38d45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.936559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa50dc9-9643-426e-9edf-94450e38d45b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:32.937378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a623abc-7e37-4202-ae7d-05843a2c4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:32.938033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623abc-7e37-4202-ae7d-05843a2c4611 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:32.938663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623abc-7e37-4202-ae7d-05843a2c4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:32.938663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623abc-7e37-4202-ae7d-05843a2c4611 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:32.939208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a623abc-7e37-4202-ae7d-05843a2c4611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:32.941149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a623abc-7e37-4202-ae7d-05843a2c4611 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.050806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 824/1623] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:33.051761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa50dc9-9643-426e-9edf-94450e38d45b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.056614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 800/1624] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:32 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:33.057835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a623abc-7e37-4202-ae7d-05843a2c4611 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.068298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa50dc9-9643-426e-9edf-94450e38d45b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.159265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576f3b-7280-4df8-aed6-2e5c55851675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.162389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576f3b-7280-4df8-aed6-2e5c55851675 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.162389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576f3b-7280-4df8-aed6-2e5c55851675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.162589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576f3b-7280-4df8-aed6-2e5c55851675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.172135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a623abc-7e37-4202-ae7d-05843a2c4611 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.177687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05517-922f-4a40-9a25-6f6c0f9aa7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.178316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05517-922f-4a40-9a25-6f6c0f9aa7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.178740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05517-922f-4a40-9a25-6f6c0f9aa7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.179020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05517-922f-4a40-9a25-6f6c0f9aa7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.179908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e05517-922f-4a40-9a25-6f6c0f9aa7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.182072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e05517-922f-4a40-9a25-6f6c0f9aa7a8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.185977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac576f3b-7280-4df8-aed6-2e5c55851675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.199339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac576f3b-7280-4df8-aed6-2e5c55851675 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.199430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 801/1625] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:33.199430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05517-922f-4a40-9a25-6f6c0f9aa7a8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.208489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05517-922f-4a40-9a25-6f6c0f9aa7a8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.220068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f02865-c581-4cf4-8bc5-210dae507461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.220068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02865-c581-4cf4-8bc5-210dae507461 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.220068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02865-c581-4cf4-8bc5-210dae507461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.220068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f02865-c581-4cf4-8bc5-210dae507461 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.220392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f02865-c581-4cf4-8bc5-210dae507461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.220392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f02865-c581-4cf4-8bc5-210dae507461 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.220821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 825/1626] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:33.222520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576f3b-7280-4df8-aed6-2e5c55851675 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.246664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576f3b-7280-4df8-aed6-2e5c55851675 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.248187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debba26-e4dd-4490-b110-a74e0aaa099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.249079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debba26-e4dd-4490-b110-a74e0aaa099c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.249440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debba26-e4dd-4490-b110-a74e0aaa099c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.249908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debba26-e4dd-4490-b110-a74e0aaa099c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.250639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debba26-e4dd-4490-b110-a74e0aaa099c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.253304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debba26-e4dd-4490-b110-a74e0aaa099c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.277255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 826/1627] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:33.278390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debba26-e4dd-4490-b110-a74e0aaa099c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.300559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 802/1628] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:33 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:33.309372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debba26-e4dd-4490-b110-a74e0aaa099c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.312050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f02865-c581-4cf4-8bc5-210dae507461 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.327915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f02865-c581-4cf4-8bc5-210dae507461 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.331287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d667a2-a0b2-4889-b4e7-3122f56af888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.332101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d667a2-a0b2-4889-b4e7-3122f56af888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.332949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d667a2-a0b2-4889-b4e7-3122f56af888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.333481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb64a0a-5674-4883-af49-1175ddaf2b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.333918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d667a2-a0b2-4889-b4e7-3122f56af888 admin admin] PATH_INFO: `/v3/projects/cec9db265c18410ca3df055105c718d2/users/12bab6e30dd747858a20b85dfddffee7/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.334292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb64a0a-5674-4883-af49-1175ddaf2b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.334519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb64a0a-5674-4883-af49-1175ddaf2b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.335067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb64a0a-5674-4883-af49-1175ddaf2b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.335671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb64a0a-5674-4883-af49-1175ddaf2b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.338059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb64a0a-5674-4883-af49-1175ddaf2b1d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.358662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 803/1629] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:33.360163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb64a0a-5674-4883-af49-1175ddaf2b1d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.371514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d667a2-a0b2-4889-b4e7-3122f56af888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec9db265c18410ca3df055105c718d2, user_id=12bab6e30dd747858a20b85dfddffee7, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.374353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d667a2-a0b2-4889-b4e7-3122f56af888 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.392380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb64a0a-5674-4883-af49-1175ddaf2b1d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.409311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37378f-539b-44cc-8c12-e520a87c5835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.409980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37378f-539b-44cc-8c12-e520a87c5835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.410267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37378f-539b-44cc-8c12-e520a87c5835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.410540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37378f-539b-44cc-8c12-e520a87c5835 admin admin] PATH_INFO: `/v3/projects/780095a8ce1b4407bad8fc2e8352c9b8/users/0ea6a74df10e44d5b59aa988ee4c602e/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.460869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 827/1630] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:33 2022] PUT /identity/v3/projects/cec9db265c18410ca3df055105c718d2/users/12bab6e30dd747858a20b85dfddffee7/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:33.461046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37378f-539b-44cc-8c12-e520a87c5835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780095a8ce1b4407bad8fc2e8352c9b8, user_id=0ea6a74df10e44d5b59aa988ee4c602e, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.461046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37378f-539b-44cc-8c12-e520a87c5835 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.462472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4120c-e3b3-4bd9-8544-40a05398ff39 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.462855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4120c-e3b3-4bd9-8544-40a05398ff39 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.463336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4120c-e3b3-4bd9-8544-40a05398ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.509122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7fe4120c-e3b3-4bd9-8544-40a05398ff39 None None] MFA Rules not processed for user `12bab6e30dd747858a20b85dfddffee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:33.510540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7fe4120c-e3b3-4bd9-8544-40a05398ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:33.563933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 804/1631] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:33 2022] PUT /identity/v3/projects/780095a8ce1b4407bad8fc2e8352c9b8/users/0ea6a74df10e44d5b59aa988ee4c602e/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:33.567715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37378f-539b-44cc-8c12-e520a87c5835 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.590729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:33.639430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 828/1632] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:09:33.644240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4120c-e3b3-4bd9-8544-40a05398ff39 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.717703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:33.747214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37378f-539b-44cc-8c12-e520a87c5835 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.757417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582178cb-aac9-4bc0-957d-29e946bae20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.758603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582178cb-aac9-4bc0-957d-29e946bae20e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.758968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582178cb-aac9-4bc0-957d-29e946bae20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.759585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582178cb-aac9-4bc0-957d-29e946bae20e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.760300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582178cb-aac9-4bc0-957d-29e946bae20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.763939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582178cb-aac9-4bc0-957d-29e946bae20e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.780181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4120c-e3b3-4bd9-8544-40a05398ff39 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.784949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 805/1633] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:33.786030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b3ed2-73fe-47fd-8625-e3860141b3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.786952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9bc8-9364-4486-9c4e-c028e302aeb2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.787091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3ed2-73fe-47fd-8625-e3860141b3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.787361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3ed2-73fe-47fd-8625-e3860141b3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.787574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9bc8-9364-4486-9c4e-c028e302aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.787658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3ed2-73fe-47fd-8625-e3860141b3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.787925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d9bc8-9364-4486-9c4e-c028e302aeb2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.788305 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b3ed2-73fe-47fd-8625-e3860141b3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.790233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 806/1634] 10.222.0.75 () {54 vars in 965 bytes} [Mon Sep 19 15:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:09:33.790501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b3ed2-73fe-47fd-8625-e3860141b3d4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.791595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9bc8-9364-4486-9c4e-c028e302aeb2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:33.815882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d9bc8-9364-4486-9c4e-c028e302aeb2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:33.822186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eda6b-2f98-4c20-b43c-59e2edcb2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:33.823024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eda6b-2f98-4c20-b43c-59e2edcb2962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.823314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eda6b-2f98-4c20-b43c-59e2edcb2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.823598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eda6b-2f98-4c20-b43c-59e2edcb2962 admin admin] PATH_INFO: `/v3/projects/780095a8ce1b4407bad8fc2e8352c9b8/users/0ea6a74df10e44d5b59aa988ee4c602e/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.826937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eda6b-2f98-4c20-b43c-59e2edcb2962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780095a8ce1b4407bad8fc2e8352c9b8, user_id=0ea6a74df10e44d5b59aa988ee4c602e, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:33.831044 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eda6b-2f98-4c20-b43c-59e2edcb2962 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:33.846381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 807/1635] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:33 2022] PUT /identity/v3/projects/780095a8ce1b4407bad8fc2e8352c9b8/users/0ea6a74df10e44d5b59aa988ee4c602e/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:33.848078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e77965-5d0a-4cf4-a136-5e7fed167f59 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.848293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e77965-5d0a-4cf4-a136-5e7fed167f59 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:33.848738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e77965-5d0a-4cf4-a136-5e7fed167f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:33.875632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-08e77965-5d0a-4cf4-a136-5e7fed167f59 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:33.876931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-08e77965-5d0a-4cf4-a136-5e7fed167f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:33.942842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 829/1636] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:33 2022] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:09:33.950650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf946a-e47d-4f44-97f0-4b2f578c2ccb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:33.950650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf946a-e47d-4f44-97f0-4b2f578c2ccb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.242812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf946a-e47d-4f44-97f0-4b2f578c2ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.242812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5ddf946a-e47d-4f44-97f0-4b2f578c2ccb None None] MFA Rules not processed for user `0ea6a74df10e44d5b59aa988ee4c602e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:34.242812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5ddf946a-e47d-4f44-97f0-4b2f578c2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:34.243451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 808/1637] 10.222.0.75 () {58 vars in 1062 bytes} [Mon Sep 19 15:09:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:34.243451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e77965-5d0a-4cf4-a136-5e7fed167f59 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:34.243451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e77965-5d0a-4cf4-a136-5e7fed167f59 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:34.245959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 830/1638] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:34.245959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ea2e-4ed6-4bf8-ba01-981ee9a749b3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.245959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ea2e-4ed6-4bf8-ba01-981ee9a749b3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.245959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ea2e-4ed6-4bf8-ba01-981ee9a749b3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.245959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 831/1639] 10.222.0.75 () {54 vars in 912 bytes} [Mon Sep 19 15:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:09:34.245959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b798b09-3439-43cf-a242-fbda75a78570 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.245959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b798b09-3439-43cf-a242-fbda75a78570 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.249597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b798b09-3439-43cf-a242-fbda75a78570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.249597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0b798b09-3439-43cf-a242-fbda75a78570 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:34.249597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0b798b09-3439-43cf-a242-fbda75a78570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:34.254265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bd2b9-62df-4dbe-b0df-f7f7318bf41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:34.254265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bd2b9-62df-4dbe-b0df-f7f7318bf41f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.254265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bd2b9-62df-4dbe-b0df-f7f7318bf41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.254265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bd2b9-62df-4dbe-b0df-f7f7318bf41f admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.255555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bd2b9-62df-4dbe-b0df-f7f7318bf41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:34.255555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bd2b9-62df-4dbe-b0df-f7f7318bf41f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:34.270620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:34.309222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 832/1640] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 19 15:09:34.324105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b798b09-3439-43cf-a242-fbda75a78570 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:34.394562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b798b09-3439-43cf-a242-fbda75a78570 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:34.398395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590fcf-482a-4e80-898f-0f319f1994f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:34.399019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590fcf-482a-4e80-898f-0f319f1994f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.399314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590fcf-482a-4e80-898f-0f319f1994f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.399596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590fcf-482a-4e80-898f-0f319f1994f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.410018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f590fcf-482a-4e80-898f-0f319f1994f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:34.414494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f590fcf-482a-4e80-898f-0f319f1994f3 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:34.416208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 809/1641] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:34 2022] POST /identity/v3/users => generated 296 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:34.417327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bd2b9-62df-4dbe-b0df-f7f7318bf41f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:34.428816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bd2b9-62df-4dbe-b0df-f7f7318bf41f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:34.435998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42adb5-4173-4c03-a445-d5a2a37f895a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:34.437161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42adb5-4173-4c03-a445-d5a2a37f895a service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.437812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42adb5-4173-4c03-a445-d5a2a37f895a service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.438541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42adb5-4173-4c03-a445-d5a2a37f895a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.438812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 833/1642] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:34.440028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590fcf-482a-4e80-898f-0f319f1994f3 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:34.457027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590fcf-482a-4e80-898f-0f319f1994f3 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:34.464436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42adb5-4173-4c03-a445-d5a2a37f895a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:34.465760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43332f-cca5-4dda-9725-df6a8ad14ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:34.476233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43332f-cca5-4dda-9725-df6a8ad14ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.476233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43332f-cca5-4dda-9725-df6a8ad14ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.476233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43332f-cca5-4dda-9725-df6a8ad14ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.476233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43332f-cca5-4dda-9725-df6a8ad14ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:34.476233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43332f-cca5-4dda-9725-df6a8ad14ca2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:34.476864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42adb5-4173-4c03-a445-d5a2a37f895a service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:34.486830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 834/1643] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:34.488696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43332f-cca5-4dda-9725-df6a8ad14ca2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:34.494670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 810/1644] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:34.502759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43332f-cca5-4dda-9725-df6a8ad14ca2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:34.509027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308818a-203f-4a25-8854-43f02525626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:34.509836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308818a-203f-4a25-8854-43f02525626b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.510222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308818a-203f-4a25-8854-43f02525626b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.510584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308818a-203f-4a25-8854-43f02525626b admin admin] PATH_INFO: `/v3/projects/7e21999e725a4f749cfe693a3c183ecb/users/9e5247d7ff974692af8499ed553ae8e3/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.531795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308818a-203f-4a25-8854-43f02525626b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e21999e725a4f749cfe693a3c183ecb, user_id=9e5247d7ff974692af8499ed553ae8e3, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:34.535128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308818a-203f-4a25-8854-43f02525626b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:34.617660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:34.664356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 835/1645] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:34 2022] PUT /identity/v3/projects/7e21999e725a4f749cfe693a3c183ecb/users/9e5247d7ff974692af8499ed553ae8e3/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:09:34.665738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42adb5-4173-4c03-a445-d5a2a37f895a service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:34.676052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42adb5-4173-4c03-a445-d5a2a37f895a service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:34.703702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308818a-203f-4a25-8854-43f02525626b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:34.752866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4a02e-d895-4ca2-9ea2-386628c61a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:34.753414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4a02e-d895-4ca2-9ea2-386628c61a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.753697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4a02e-d895-4ca2-9ea2-386628c61a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.753968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4a02e-d895-4ca2-9ea2-386628c61a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.754617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4a02e-d895-4ca2-9ea2-386628c61a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:34.756289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4a02e-d895-4ca2-9ea2-386628c61a0a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:34.768649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 811/1646] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:09:34.775750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4a02e-d895-4ca2-9ea2-386628c61a0a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:34.785589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4a02e-d895-4ca2-9ea2-386628c61a0a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:34.792862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc9e45-a6f8-43d9-a25a-af5d06a6d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:34.793809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc9e45-a6f8-43d9-a25a-af5d06a6d211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.794128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc9e45-a6f8-43d9-a25a-af5d06a6d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.794476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc9e45-a6f8-43d9-a25a-af5d06a6d211 admin admin] PATH_INFO: `/v3/projects/7e21999e725a4f749cfe693a3c183ecb/users/9e5247d7ff974692af8499ed553ae8e3/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.797437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc9e45-a6f8-43d9-a25a-af5d06a6d211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e21999e725a4f749cfe693a3c183ecb, user_id=9e5247d7ff974692af8499ed553ae8e3, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:34.800425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc9e45-a6f8-43d9-a25a-af5d06a6d211 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:34.814936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 812/1647] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:34 2022] PUT /identity/v3/projects/7e21999e725a4f749cfe693a3c183ecb/users/9e5247d7ff974692af8499ed553ae8e3/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:09:34.828296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431ab6-5d9e-4d59-ac8b-295a261774ce None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.828919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431ab6-5d9e-4d59-ac8b-295a261774ce None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.832841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431ab6-5d9e-4d59-ac8b-295a261774ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:34.835229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308818a-203f-4a25-8854-43f02525626b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:34.899489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8a431ab6-5d9e-4d59-ac8b-295a261774ce None None] MFA Rules not processed for user `9e5247d7ff974692af8499ed553ae8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:34.902741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8a431ab6-5d9e-4d59-ac8b-295a261774ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:34.966332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b43b1d-3fc8-4e78-b49e-6af34b08ed89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:34.967046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43b1d-3fc8-4e78-b49e-6af34b08ed89 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:34.967446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43b1d-3fc8-4e78-b49e-6af34b08ed89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:34.967833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43b1d-3fc8-4e78-b49e-6af34b08ed89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:35.039885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 813/1648] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:35.053756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431ab6-5d9e-4d59-ac8b-295a261774ce None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:35.069145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431ab6-5d9e-4d59-ac8b-295a261774ce None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:35.074771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b43b1d-3fc8-4e78-b49e-6af34b08ed89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:35.075521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad302d-42c0-4f6a-85d9-28934fbcba81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:35.076655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b43b1d-3fc8-4e78-b49e-6af34b08ed89 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:35.077361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad302d-42c0-4f6a-85d9-28934fbcba81 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:35.077741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad302d-42c0-4f6a-85d9-28934fbcba81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:35.078131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad302d-42c0-4f6a-85d9-28934fbcba81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:35.092392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad302d-42c0-4f6a-85d9-28934fbcba81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:35.094524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad302d-42c0-4f6a-85d9-28934fbcba81 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:35.105956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 836/1649] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:35.124397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 814/1650] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:35.194724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:35.239845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b43b1d-3fc8-4e78-b49e-6af34b08ed89 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:35.249218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b43b1d-3fc8-4e78-b49e-6af34b08ed89 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:35.252974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abddde-da4e-41e2-9c59-2b5b42b7efca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:35.253642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abddde-da4e-41e2-9c59-2b5b42b7efca service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:35.253993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abddde-da4e-41e2-9c59-2b5b42b7efca service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:35.254327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abddde-da4e-41e2-9c59-2b5b42b7efca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:35.278104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9dde0-7d12-4868-a95d-cf236a446093 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:35.278660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9dde0-7d12-4868-a95d-cf236a446093 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:35.278745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9dde0-7d12-4868-a95d-cf236a446093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:35.336789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-dce9dde0-7d12-4868-a95d-cf236a446093 None None] MFA Rules not processed for user `4b1cafa99cb14c2697b38806c69be811`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:35.337711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dce9dde0-7d12-4868-a95d-cf236a446093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:35.355032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abddde-da4e-41e2-9c59-2b5b42b7efca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:35.357021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abddde-da4e-41e2-9c59-2b5b42b7efca service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:35.383695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 837/1651] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:35.427622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:35.480701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 815/1652] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:09:35.481076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abddde-da4e-41e2-9c59-2b5b42b7efca service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:35.614318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abddde-da4e-41e2-9c59-2b5b42b7efca service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:35.630012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf7b5-c2e3-4400-96cb-127589b05b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:35.631048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf7b5-c2e3-4400-96cb-127589b05b17 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:35.632933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf7b5-c2e3-4400-96cb-127589b05b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:35.634460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf7b5-c2e3-4400-96cb-127589b05b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:35.635285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf7b5-c2e3-4400-96cb-127589b05b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:35.639751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf7b5-c2e3-4400-96cb-127589b05b17 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:35.794893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 838/1653] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:35 2022] POST /identity/v3/projects => generated 403 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:35.800117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9dde0-7d12-4868-a95d-cf236a446093 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:35.817200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9dde0-7d12-4868-a95d-cf236a446093 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:35.946548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e380cc9-60af-49b5-a716-a058fc3c2ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:35.947833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380cc9-60af-49b5-a716-a058fc3c2ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:35.948160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380cc9-60af-49b5-a716-a058fc3c2ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:35.948444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380cc9-60af-49b5-a716-a058fc3c2ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:35.949426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e380cc9-60af-49b5-a716-a058fc3c2ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:35.952147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e380cc9-60af-49b5-a716-a058fc3c2ae6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:36.068598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 816/1654] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:35 2022] POST /identity/v3/users => generated 308 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:36.073413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf7b5-c2e3-4400-96cb-127589b05b17 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:36.101937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf7b5-c2e3-4400-96cb-127589b05b17 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:36.120472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2e485-47db-48a6-a121-5a6277983899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:36.121354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2e485-47db-48a6-a121-5a6277983899 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:36.121539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2e485-47db-48a6-a121-5a6277983899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:36.121787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2e485-47db-48a6-a121-5a6277983899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:36.129689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2e485-47db-48a6-a121-5a6277983899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:36.129689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2e485-47db-48a6-a121-5a6277983899 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:36.136657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 839/1655] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:36.140721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e380cc9-60af-49b5-a716-a058fc3c2ae6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:36.168600 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e380cc9-60af-49b5-a716-a058fc3c2ae6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:36.183289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eec3c3-3c0e-4e1b-9251-1687065e0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:36.185649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eec3c3-3c0e-4e1b-9251-1687065e0bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:36.185940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eec3c3-3c0e-4e1b-9251-1687065e0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:36.186980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eec3c3-3c0e-4e1b-9251-1687065e0bba admin admin] PATH_INFO: `/v3/projects/c50138a405ec49399d9534bb623dac15/users/2c632a056e4f4f9388a76abe8a823901/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:36.223950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eec3c3-3c0e-4e1b-9251-1687065e0bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50138a405ec49399d9534bb623dac15, user_id=2c632a056e4f4f9388a76abe8a823901, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:36.228866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eec3c3-3c0e-4e1b-9251-1687065e0bba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:36.331140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 817/1656] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:36 2022] PUT /identity/v3/projects/c50138a405ec49399d9534bb623dac15/users/2c632a056e4f4f9388a76abe8a823901/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:36.335434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2e485-47db-48a6-a121-5a6277983899 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:36.348841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2e485-47db-48a6-a121-5a6277983899 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:36.502316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:36.517556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa87fd3-b19d-476b-a75f-fd1521fbee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:36.518201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87fd3-b19d-476b-a75f-fd1521fbee02 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:36.536811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87fd3-b19d-476b-a75f-fd1521fbee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:36.540387 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87fd3-b19d-476b-a75f-fd1521fbee02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:36.541445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa87fd3-b19d-476b-a75f-fd1521fbee02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:36.543302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa87fd3-b19d-476b-a75f-fd1521fbee02 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:36.559384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 840/1657] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:36.560787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eec3c3-3c0e-4e1b-9251-1687065e0bba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:36.579566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eec3c3-3c0e-4e1b-9251-1687065e0bba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:36.584910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313c9e8-93fb-4367-9832-7d3a9618f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:36.586585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313c9e8-93fb-4367-9832-7d3a9618f0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:36.587372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313c9e8-93fb-4367-9832-7d3a9618f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:36.588133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313c9e8-93fb-4367-9832-7d3a9618f0c3 admin admin] PATH_INFO: `/v3/projects/c50138a405ec49399d9534bb623dac15/users/2c632a056e4f4f9388a76abe8a823901/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:36.590759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313c9e8-93fb-4367-9832-7d3a9618f0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50138a405ec49399d9534bb623dac15, user_id=2c632a056e4f4f9388a76abe8a823901, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:36.594192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313c9e8-93fb-4367-9832-7d3a9618f0c3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:36.629865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 818/1658] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:36 2022] PUT /identity/v3/projects/c50138a405ec49399d9534bb623dac15/users/2c632a056e4f4f9388a76abe8a823901/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:39.722138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f891-8997-46cc-b0db-7de84bd0fbfe None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:39.722906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f891-8997-46cc-b0db-7de84bd0fbfe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:39.733410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f891-8997-46cc-b0db-7de84bd0fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:39.807684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bd01f891-8997-46cc-b0db-7de84bd0fbfe None None] MFA Rules not processed for user `2c632a056e4f4f9388a76abe8a823901`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:39.814764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bd01f891-8997-46cc-b0db-7de84bd0fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:40.134935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 841/1659] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:42.978931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de3db-4c56-4c0d-baea-7e359a7dffc4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:42.979510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de3db-4c56-4c0d-baea-7e359a7dffc4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:42.979510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de3db-4c56-4c0d-baea-7e359a7dffc4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:42.981174 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 819/1660] 10.222.0.75 () {54 vars in 921 bytes} [Mon Sep 19 15:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:09:43.003084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f061a-904b-4f16-ad3b-418fb32094bf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:43.003641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f061a-904b-4f16-ad3b-418fb32094bf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:43.003641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f061a-904b-4f16-ad3b-418fb32094bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:43.048591 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-812f061a-904b-4f16-ad3b-418fb32094bf None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:43.049849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-812f061a-904b-4f16-ad3b-418fb32094bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:43.230051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 842/1661] 10.222.0.75 () {58 vars in 1018 bytes} [Mon Sep 19 15:09:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:43.273691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de3db-4c56-4c0d-baea-7e359a7dffc4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:43.296469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de3db-4c56-4c0d-baea-7e359a7dffc4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:43.309773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca22dcc-e368-4277-895a-48d5b9c88a2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:43.309773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22dcc-e368-4277-895a-48d5b9c88a2f service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:43.309773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22dcc-e368-4277-895a-48d5b9c88a2f service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:43.309773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22dcc-e368-4277-895a-48d5b9c88a2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:43.319450 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca22dcc-e368-4277-895a-48d5b9c88a2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:43.322694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca22dcc-e368-4277-895a-48d5b9c88a2f service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:43.346889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 820/1662] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:45.305449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c75-8ca1-46e3-a6c3-1e7a0b5f5fa0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:45.306959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c75-8ca1-46e3-a6c3-1e7a0b5f5fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:45.307496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c75-8ca1-46e3-a6c3-1e7a0b5f5fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:45.379656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3ef41c75-8ca1-46e3-a6c3-1e7a0b5f5fa0 None None] MFA Rules not processed for user `833edf46ef9b4d3982ce49abc74933a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:45.393732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ef41c75-8ca1-46e3-a6c3-1e7a0b5f5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:45.466604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807201-a2fb-45d9-8c15-ca4159e81638 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:45.467379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807201-a2fb-45d9-8c15-ca4159e81638 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:45.467669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807201-a2fb-45d9-8c15-ca4159e81638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:45.487722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:45.536040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-02807201-a2fb-45d9-8c15-ca4159e81638 None None] MFA Rules not processed for user `6452ad1301fb4f2aa2f0c015463455c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:45.538113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-02807201-a2fb-45d9-8c15-ca4159e81638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:45.558094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 843/1663] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:45.579309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41c75-8ca1-46e3-a6c3-1e7a0b5f5fa0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:45.785893 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:45.787764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41c75-8ca1-46e3-a6c3-1e7a0b5f5fa0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:45.796018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbe7f2-195a-4b4a-844a-92e9e7cc5a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:45.799766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbe7f2-195a-4b4a-844a-92e9e7cc5a7d service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:45.799766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbe7f2-195a-4b4a-844a-92e9e7cc5a7d service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:45.799766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbe7f2-195a-4b4a-844a-92e9e7cc5a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:45.799965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 821/1664] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:45.812756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338829c7-ffaf-4d69-94e2-5d9b0c39bdfb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:45.813582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338829c7-ffaf-4d69-94e2-5d9b0c39bdfb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:45.814302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338829c7-ffaf-4d69-94e2-5d9b0c39bdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:45.821222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbe7f2-195a-4b4a-844a-92e9e7cc5a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:45.824016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbe7f2-195a-4b4a-844a-92e9e7cc5a7d service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:45.836139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 844/1665] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:45.845834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-338829c7-ffaf-4d69-94e2-5d9b0c39bdfb None None] MFA Rules not processed for user `6452ad1301fb4f2aa2f0c015463455c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:45.847228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-338829c7-ffaf-4d69-94e2-5d9b0c39bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:45.875829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 822/1666] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:09:45.938558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbe7f2-195a-4b4a-844a-92e9e7cc5a7d service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:45.967211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbe7f2-195a-4b4a-844a-92e9e7cc5a7d service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:45.995459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40730-cbfc-4d6a-a480-a2daad174a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:45.995642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40730-cbfc-4d6a-a480-a2daad174a9c service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:45.995827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40730-cbfc-4d6a-a480-a2daad174a9c service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:45.996102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40730-cbfc-4d6a-a480-a2daad174a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:46.021614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b40730-cbfc-4d6a-a480-a2daad174a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:46.023766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b40730-cbfc-4d6a-a480-a2daad174a9c service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:46.054292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 845/1667] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:46.127521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338829c7-ffaf-4d69-94e2-5d9b0c39bdfb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:46.218689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338829c7-ffaf-4d69-94e2-5d9b0c39bdfb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:46.225200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:46.226818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:46.227548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:46.228283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] PATH_INFO: `/v3/users/3d301818367c472b963fe9d5bbadfa8f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:46.230352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d301818367c472b963fe9d5bbadfa8f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:46.232773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:46.430011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d301818367c472b963fe9d5bbadfa8f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:46.443610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d301818367c472b963fe9d5bbadfa8f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:46.474943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d301818367c472b963fe9d5bbadfa8f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:46.575093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d301818367c472b963fe9d5bbadfa8f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:46.576007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d301818367c472b963fe9d5bbadfa8f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:46.584788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 823/1668] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:09:46 2022] DELETE /identity/v3/users/3d301818367c472b963fe9d5bbadfa8f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:46.589730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c2aee-2299-40bb-9c10-900a9ea08ea3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:46.590220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c2aee-2299-40bb-9c10-900a9ea08ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:46.590526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c2aee-2299-40bb-9c10-900a9ea08ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:46.640745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f84c2aee-2299-40bb-9c10-900a9ea08ea3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:46.642102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f84c2aee-2299-40bb-9c10-900a9ea08ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:46.708647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:46.711438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:46.834942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 846/1669] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:46.840040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f15aaf-bd32-4f5e-b893-fc9d1442bb36 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:46.840431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f15aaf-bd32-4f5e-b893-fc9d1442bb36 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:46.841367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f15aaf-bd32-4f5e-b893-fc9d1442bb36 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:46.843522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 847/1670] 10.222.0.75 () {54 vars in 912 bytes} [Mon Sep 19 15:09:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:09:46.858564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a402acc-e755-4a4e-8117-5a9b05e22097 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:46.859112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a402acc-e755-4a4e-8117-5a9b05e22097 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:46.859496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a402acc-e755-4a4e-8117-5a9b05e22097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:46.872111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75a635-f4d2-4a21-81ab-d115e00de6a6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:46.888118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:46.888768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:46.889041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:46.889319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] PATH_INFO: `/v3/users/4b1cafa99cb14c2697b38806c69be811` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:46.893875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1cafa99cb14c2697b38806c69be811)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:46.896103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:46.935509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:46.943915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5a402acc-e755-4a4e-8117-5a9b05e22097 None None] MFA Rules not processed for user `67d0bbf089504d408db0bb7055a780a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:46.946272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5a402acc-e755-4a4e-8117-5a9b05e22097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:47.009084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:47.061128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 848/1671] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:47.063019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a402acc-e755-4a4e-8117-5a9b05e22097 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:47.064568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5a402acc-e755-4a4e-8117-5a9b05e22097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:47.097997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a402acc-e755-4a4e-8117-5a9b05e22097 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:47.103130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836c47-3d74-4721-9b73-2b102ab83f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:47.104651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836c47-3d74-4721-9b73-2b102ab83f47 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:47.105254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836c47-3d74-4721-9b73-2b102ab83f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:47.117889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836c47-3d74-4721-9b73-2b102ab83f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:47.150291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836c47-3d74-4721-9b73-2b102ab83f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:47.150291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836c47-3d74-4721-9b73-2b102ab83f47 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:47.161796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 849/1672] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:47.162631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836c47-3d74-4721-9b73-2b102ab83f47 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:47.174086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1cafa99cb14c2697b38806c69be811'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:47.176908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836c47-3d74-4721-9b73-2b102ab83f47 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:47.190083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:47.190928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:47.190928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:47.191287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:47.194225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1cafa99cb14c2697b38806c69be811'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:47.213880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:47.220137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:47.230617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1cafa99cb14c2697b38806c69be811'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:47.259352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 850/1673] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:47.330319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1cafa99cb14c2697b38806c69be811'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:47.330894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1cafa99cb14c2697b38806c69be811'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:47.341921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 824/1674] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:09:46 2022] DELETE /identity/v3/users/4b1cafa99cb14c2697b38806c69be811 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:48.822781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:48.827740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:48.944056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:48.946970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:49.041760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a566d9a-cdd1-494a-befa-070d24169522 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:49.064399 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8170f4-b127-4212-9aee-773e132e4551 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:49.071621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:49.074067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:49.075118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:49.075405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] PATH_INFO: `/v3/projects/80f8731fe34a41ce9ec7b0cf105d6135` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:49.076752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f8731fe34a41ce9ec7b0cf105d6135)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:49.077949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: WARNING py.warnings [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:09:49.077949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: warnings.warn(msg) Sep 19 15:09:49.077949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: Sep 19 15:09:49.079389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:49.256295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93a017-489b-4036-b5f4-a8c00c543400 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:49.257727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93a017-489b-4036-b5f4-a8c00c543400 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:49.257727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93a017-489b-4036-b5f4-a8c00c543400 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:49.257727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93a017-489b-4036-b5f4-a8c00c543400 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:49.269489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6b93a017-489b-4036-b5f4-a8c00c543400 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:49.300507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93a017-489b-4036-b5f4-a8c00c543400 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:49.302672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93a017-489b-4036-b5f4-a8c00c543400 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:49.338363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 851/1675] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:49.339931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989335-e86e-417a-9481-8b0f78d3add2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:49.344600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989335-e86e-417a-9481-8b0f78d3add2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:49.345067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989335-e86e-417a-9481-8b0f78d3add2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:49.370952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f8731fe34a41ce9ec7b0cf105d6135', 'request_id': 'req-3262212b-4ccb-41d8-9c82-c967664a6a30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:49.434085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f8989335-e86e-417a-9481-8b0f78d3add2 None None] MFA Rules not processed for user `fb7200a9769b46b3a79c9fe6287a1724`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:49.437629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f8989335-e86e-417a-9481-8b0f78d3add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:49.466973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f8731fe34a41ce9ec7b0cf105d6135', 'request_id': 'req-3262212b-4ccb-41d8-9c82-c967664a6a30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:49.511890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f8731fe34a41ce9ec7b0cf105d6135', 'request_id': 'req-3262212b-4ccb-41d8-9c82-c967664a6a30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:49.548980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] The token cache is being invalidate because project 80f8731fe34a41ce9ec7b0cf105d6135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:09:49.551994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:49.553344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:49.557332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:49.558150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 825/1676] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:09:48 2022] DELETE /identity/v3/projects/80f8731fe34a41ce9ec7b0cf105d6135 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:49.565179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:49.570458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:49.628385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 852/1677] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:49.629408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989335-e86e-417a-9481-8b0f78d3add2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:49.630960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f8989335-e86e-417a-9481-8b0f78d3add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:49.644619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:49.736063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262212b-4ccb-41d8-9c82-c967664a6a30 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:49.754202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:49.758248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:49.758877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:49.759141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] PATH_INFO: `/v3/projects/5bc82dc1b38c47a6ba15c2b37684229d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:49.770465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc82dc1b38c47a6ba15c2b37684229d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:49.772430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:49.812162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989335-e86e-417a-9481-8b0f78d3add2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:49.831245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:49.831245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:49.831245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:49.831245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] PATH_INFO: `/v3/users/2c632a056e4f4f9388a76abe8a823901` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:49.839024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c632a056e4f4f9388a76abe8a823901)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:49.842701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: WARNING py.warnings [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 15:09:49.842701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: warnings.warn(msg) Sep 19 15:09:49.842701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: Sep 19 15:09:49.844300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:50.090007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc82dc1b38c47a6ba15c2b37684229d', 'request_id': 'req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.157419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c632a056e4f4f9388a76abe8a823901'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.164872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc82dc1b38c47a6ba15c2b37684229d', 'request_id': 'req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.173641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc82dc1b38c47a6ba15c2b37684229d', 'request_id': 'req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.193310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] The token cache is being invalidate because project 5bc82dc1b38c47a6ba15c2b37684229d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:09:50.193609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.195404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.198740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 826/1678] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:09:49 2022] DELETE /identity/v3/projects/5bc82dc1b38c47a6ba15c2b37684229d => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:50.206435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:50.208503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:50.217477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c632a056e4f4f9388a76abe8a823901'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.247917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c632a056e4f4f9388a76abe8a823901'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.329408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c632a056e4f4f9388a76abe8a823901'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.330067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c4c80d69-7339-4ce1-8590-679a3966adf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c632a056e4f4f9388a76abe8a823901'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:50.343479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 853/1679] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:09:49 2022] DELETE /identity/v3/users/2c632a056e4f4f9388a76abe8a823901 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:50.343479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299701ba-8708-4a14-a027-f08f38ab7ea8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:50.343479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299701ba-8708-4a14-a027-f08f38ab7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:50.343479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299701ba-8708-4a14-a027-f08f38ab7ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:50.386981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df2442-e4c3-4558-9ae9-0ab886ebfbc1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:50.433101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-299701ba-8708-4a14-a027-f08f38ab7ea8 None None] MFA Rules not processed for user `808156c7457b4e8b9b6c5f305755b3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:50.434391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-299701ba-8708-4a14-a027-f08f38ab7ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:50.533840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:50.570508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:50.571466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:50.572065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:50.572716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:50.579267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:50.588681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:50.643136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 854/1680] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:50.644234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299701ba-8708-4a14-a027-f08f38ab7ea8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:50.648542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-299701ba-8708-4a14-a027-f08f38ab7ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:50.712177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:50.716379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:50.749018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 827/1681] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:50.749018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:50.749018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:50.786771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679c04-1319-4430-92f2-f1c4cd862beb service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:50.811487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:50.823684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299701ba-8708-4a14-a027-f08f38ab7ea8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:50.829668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:50.830033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:50.833878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:50.846485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:50.847140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:50.848624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:50.849094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] PATH_INFO: `/v3/users/12bab6e30dd747858a20b85dfddffee7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:50.852551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bab6e30dd747858a20b85dfddffee7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:50.858854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:50.861524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:50.866045 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:50.884388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 828/1682] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:51.164965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bab6e30dd747858a20b85dfddffee7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.207759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bab6e30dd747858a20b85dfddffee7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.237702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bab6e30dd747858a20b85dfddffee7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.266814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:51.268262 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:51.294046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e48f1-c38d-4654-9f5e-44c56ccc80ea service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:51.311481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:51.312511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:51.312803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:51.313083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] PATH_INFO: `/v3/projects/c50138a405ec49399d9534bb623dac15` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:51.314387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50138a405ec49399d9534bb623dac15)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:51.316778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:51.358972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bab6e30dd747858a20b85dfddffee7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.359686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c2cf48-c00f-4196-86b4-de4dfa010dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bab6e30dd747858a20b85dfddffee7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.372040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 855/1683] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:09:50 2022] DELETE /identity/v3/users/12bab6e30dd747858a20b85dfddffee7 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:51.528527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50138a405ec49399d9534bb623dac15', 'request_id': 'req-03d3836d-c200-44aa-a062-8e265a242b85'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.598784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50138a405ec49399d9534bb623dac15', 'request_id': 'req-03d3836d-c200-44aa-a062-8e265a242b85'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.610978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50138a405ec49399d9534bb623dac15', 'request_id': 'req-03d3836d-c200-44aa-a062-8e265a242b85'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.635496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] The token cache is being invalidate because project c50138a405ec49399d9534bb623dac15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:09:51.635942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.637176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03d3836d-c200-44aa-a062-8e265a242b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:51.643817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 829/1684] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:09:51 2022] DELETE /identity/v3/projects/c50138a405ec49399d9534bb623dac15 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:51.646987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6a04d-a1f6-4336-949b-afb44b515e9f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:51.647286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6a04d-a1f6-4336-949b-afb44b515e9f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:51.648557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6a04d-a1f6-4336-949b-afb44b515e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:51.717360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1de6a04d-a1f6-4336-949b-afb44b515e9f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:51.720984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1de6a04d-a1f6-4336-949b-afb44b515e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:51.921904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 856/1685] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:51.931765 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2b078-2f32-4100-b47e-8e7168b62fe1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:51.932131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2b078-2f32-4100-b47e-8e7168b62fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:51.933627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2b078-2f32-4100-b47e-8e7168b62fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:51.975332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b2b2b078-2f32-4100-b47e-8e7168b62fe1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:51.977972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b2b2b078-2f32-4100-b47e-8e7168b62fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:51.996884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 830/1686] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:51.999041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6a04d-a1f6-4336-949b-afb44b515e9f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:52.020929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6a04d-a1f6-4336-949b-afb44b515e9f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:52.041288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:52.043228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:52.045898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:52.046589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:52.048155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:52.048648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:52.052562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:52.098569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:52.113811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 857/1687] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:09:52.115073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2b078-2f32-4100-b47e-8e7168b62fe1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:52.142995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2b078-2f32-4100-b47e-8e7168b62fe1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:52.173101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:52.178785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:52.178785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:52.178785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:52.178785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:52.178785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:52.306950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 831/1688] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:52 2022] POST /identity/v3/projects => generated 361 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:52.308802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:52.337011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244686b-d6c4-4ec9-a749-382a4c9f66d6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:52.402990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:52.406773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:52.467414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006c2a-5acb-40e3-9dff-66e5e0f99071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:52.468240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006c2a-5acb-40e3-9dff-66e5e0f99071 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:52.469179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006c2a-5acb-40e3-9dff-66e5e0f99071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:52.473071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006c2a-5acb-40e3-9dff-66e5e0f99071 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:52.474004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0006c2a-5acb-40e3-9dff-66e5e0f99071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:52.486574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0006c2a-5acb-40e3-9dff-66e5e0f99071 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:52.529354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:52.620737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f22e3-20db-4584-b60f-1d87cc98c089 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:52.628812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:52.630197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:52.630694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:52.631172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] PATH_INFO: `/v3/users/125691945edf41e39d74c7258d375c85` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:52.631443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 858/1689] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:52 2022] POST /identity/v3/users => generated 281 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:52.636387 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006c2a-5acb-40e3-9dff-66e5e0f99071 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:52.637423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125691945edf41e39d74c7258d375c85)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:52.639772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:52.675785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006c2a-5acb-40e3-9dff-66e5e0f99071 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:52.690223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676c1f-9e3d-4dd4-a8d1-6bf2d76c8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:52.690860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676c1f-9e3d-4dd4-a8d1-6bf2d76c8876 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:52.691137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676c1f-9e3d-4dd4-a8d1-6bf2d76c8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:52.691411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676c1f-9e3d-4dd4-a8d1-6bf2d76c8876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:52.692067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676c1f-9e3d-4dd4-a8d1-6bf2d76c8876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:52.693726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676c1f-9e3d-4dd4-a8d1-6bf2d76c8876 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:52.716868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 859/1690] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:52.721492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676c1f-9e3d-4dd4-a8d1-6bf2d76c8876 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:52.744744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676c1f-9e3d-4dd4-a8d1-6bf2d76c8876 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:52.758137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf991c-c425-47cc-ba6e-e54b9262a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:52.758708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf991c-c425-47cc-ba6e-e54b9262a953 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:52.758992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf991c-c425-47cc-ba6e-e54b9262a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:52.759269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf991c-c425-47cc-ba6e-e54b9262a953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:52.761457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf991c-c425-47cc-ba6e-e54b9262a953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:52.764439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf991c-c425-47cc-ba6e-e54b9262a953 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:52.833766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 860/1691] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:52.840873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf991c-c425-47cc-ba6e-e54b9262a953 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:52.864446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf991c-c425-47cc-ba6e-e54b9262a953 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:52.879378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a705d5c-5f35-4167-9b53-3e8a328872f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:52.880163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705d5c-5f35-4167-9b53-3e8a328872f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:52.881737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705d5c-5f35-4167-9b53-3e8a328872f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:52.885329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a705d5c-5f35-4167-9b53-3e8a328872f9 admin admin] PATH_INFO: `/v3/projects/bdd9a6347d854dcc9869fa3b16416d15/users/e3d367c061d6460e849259dd2f566f44/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:52.939676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125691945edf41e39d74c7258d375c85'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:52.959493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125691945edf41e39d74c7258d375c85'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:52.963774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a705d5c-5f35-4167-9b53-3e8a328872f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd9a6347d854dcc9869fa3b16416d15, user_id=e3d367c061d6460e849259dd2f566f44, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:52.966533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a705d5c-5f35-4167-9b53-3e8a328872f9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:52.999031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125691945edf41e39d74c7258d375c85'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:53.095731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 861/1692] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:52 2022] PUT /identity/v3/projects/bdd9a6347d854dcc9869fa3b16416d15/users/e3d367c061d6460e849259dd2f566f44/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:09:53.097021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77365bab-1ef3-4f67-bac8-1e01f012bcae None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:53.097308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77365bab-1ef3-4f67-bac8-1e01f012bcae None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:53.097583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77365bab-1ef3-4f67-bac8-1e01f012bcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:53.115258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125691945edf41e39d74c7258d375c85'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:53.115935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fdf021d6-298f-4ae6-a165-91848543e5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125691945edf41e39d74c7258d375c85'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:53.124754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 832/1693] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:09:52 2022] DELETE /identity/v3/users/125691945edf41e39d74c7258d375c85 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:53.126207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419a181-7a0e-449a-b640-483f15498c0b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:53.127445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419a181-7a0e-449a-b640-483f15498c0b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:53.127445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419a181-7a0e-449a-b640-483f15498c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:53.189113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-77365bab-1ef3-4f67-bac8-1e01f012bcae None None] MFA Rules not processed for user `833edf46ef9b4d3982ce49abc74933a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:53.190410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-77365bab-1ef3-4f67-bac8-1e01f012bcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:53.218012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c419a181-7a0e-449a-b640-483f15498c0b None None] MFA Rules not processed for user `e3d367c061d6460e849259dd2f566f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:53.226943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c419a181-7a0e-449a-b640-483f15498c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:53.391377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 862/1694] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:53.393245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73690d71-abdb-4bca-a861-6d6d464ff45a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:53.393833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73690d71-abdb-4bca-a861-6d6d464ff45a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:53.394251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73690d71-abdb-4bca-a861-6d6d464ff45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:53.438255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-73690d71-abdb-4bca-a861-6d6d464ff45a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:53.439747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-73690d71-abdb-4bca-a861-6d6d464ff45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:53.488141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 833/1695] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:53.497332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419a181-7a0e-449a-b640-483f15498c0b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:53.505376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c419a181-7a0e-449a-b640-483f15498c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:53.628128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 863/1696] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:53.629653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73690d71-abdb-4bca-a861-6d6d464ff45a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:53.631545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-73690d71-abdb-4bca-a861-6d6d464ff45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:53.715055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:53.717440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73690d71-abdb-4bca-a861-6d6d464ff45a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:53.725342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:53.727033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:53.729295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:53.730676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:53.732438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:53.734935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:53.762432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419a181-7a0e-449a-b640-483f15498c0b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:53.770493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:53.771391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:53.771677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:53.771959 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] PATH_INFO: `/v3/projects/cec9db265c18410ca3df055105c718d2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:53.773724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec9db265c18410ca3df055105c718d2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:53.775858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:53.866919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 864/1697] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:53 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:53.868647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:53.871798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:53.973372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec9db265c18410ca3df055105c718d2', 'request_id': 'req-b1bf0511-1025-4650-8e33-7ce4f8970d5e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.049489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6f21a-6579-44df-8c86-f37cb1de3ab6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:54.057694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec9db265c18410ca3df055105c718d2', 'request_id': 'req-b1bf0511-1025-4650-8e33-7ce4f8970d5e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.065067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec9db265c18410ca3df055105c718d2', 'request_id': 'req-b1bf0511-1025-4650-8e33-7ce4f8970d5e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.078582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] The token cache is being invalidate because project cec9db265c18410ca3df055105c718d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:09:54.079398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.082047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.084660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 834/1698] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:09:53 2022] DELETE /identity/v3/projects/cec9db265c18410ca3df055105c718d2 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:54.086616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:54.088456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:54.168540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:54.169248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:54.169531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:54.169810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:54.173792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:54.208050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf0511-1025-4650-8e33-7ce4f8970d5e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:54.216028 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6479-c064-4197-a06c-35c1b22a6fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:54.216840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6479-c064-4197-a06c-35c1b22a6fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:54.217382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6479-c064-4197-a06c-35c1b22a6fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:54.217757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6479-c064-4197-a06c-35c1b22a6fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:54.218562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab6479-c064-4197-a06c-35c1b22a6fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:54.221203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab6479-c064-4197-a06c-35c1b22a6fe1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:54.298565 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:54.300827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:54.316316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 865/1699] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:54.317672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:54.319318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:54.335769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae579c1-ad8c-4996-afa7-ea2607aa99d8 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:54.348574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 835/1700] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:54 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:54.353184 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6479-c064-4197-a06c-35c1b22a6fe1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:54.358953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:54.361458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:54.362051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:54.362683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] PATH_INFO: `/v3/users/9e5247d7ff974692af8499ed553ae8e3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:54.365332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5247d7ff974692af8499ed553ae8e3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:54.371626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:54.377737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6479-c064-4197-a06c-35c1b22a6fe1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:54.398753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acea4c7-99ad-47ae-a866-68dd820c2378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:54.398753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acea4c7-99ad-47ae-a866-68dd820c2378 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:54.398753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acea4c7-99ad-47ae-a866-68dd820c2378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:54.398753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acea4c7-99ad-47ae-a866-68dd820c2378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:54.399270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acea4c7-99ad-47ae-a866-68dd820c2378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:54.403382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acea4c7-99ad-47ae-a866-68dd820c2378 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:54.434624 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 836/1701] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:54.440837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acea4c7-99ad-47ae-a866-68dd820c2378 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:54.452425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acea4c7-99ad-47ae-a866-68dd820c2378 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:54.460771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac3a4-f658-4d6b-a213-8b901c3fc3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:54.461718 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac3a4-f658-4d6b-a213-8b901c3fc3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:54.462002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac3a4-f658-4d6b-a213-8b901c3fc3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:54.462281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac3a4-f658-4d6b-a213-8b901c3fc3f0 admin admin] PATH_INFO: `/v3/projects/4365d1e9071347f6a06c9d9c07e548e8/users/3a0185fcb53b4ab0badd98de970d864a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:54.488862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:54.508788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac3a4-f658-4d6b-a213-8b901c3fc3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4365d1e9071347f6a06c9d9c07e548e8, user_id=3a0185fcb53b4ab0badd98de970d864a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:54.514671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac3a4-f658-4d6b-a213-8b901c3fc3f0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:54.634591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 837/1702] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:54 2022] PUT /identity/v3/projects/4365d1e9071347f6a06c9d9c07e548e8/users/3a0185fcb53b4ab0badd98de970d864a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:54.636084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac3a4-f658-4d6b-a213-8b901c3fc3f0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:54.706495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5247d7ff974692af8499ed553ae8e3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.738447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5247d7ff974692af8499ed553ae8e3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.748527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5247d7ff974692af8499ed553ae8e3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.758031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac3a4-f658-4d6b-a213-8b901c3fc3f0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:54.771651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43e6da-4cfa-4a22-a23d-2779ca862558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:54.772394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e6da-4cfa-4a22-a23d-2779ca862558 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:54.773307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e6da-4cfa-4a22-a23d-2779ca862558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:54.773632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e6da-4cfa-4a22-a23d-2779ca862558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:54.774518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43e6da-4cfa-4a22-a23d-2779ca862558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:54.776400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43e6da-4cfa-4a22-a23d-2779ca862558 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:54.805557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 838/1703] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:54.810816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43e6da-4cfa-4a22-a23d-2779ca862558 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:54.825118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43e6da-4cfa-4a22-a23d-2779ca862558 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:54.830736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd1bf8-3d73-4e6c-9a65-9ad5e77209d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:54.831614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd1bf8-3d73-4e6c-9a65-9ad5e77209d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:54.832825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd1bf8-3d73-4e6c-9a65-9ad5e77209d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:54.832825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd1bf8-3d73-4e6c-9a65-9ad5e77209d0 admin admin] PATH_INFO: `/v3/projects/4365d1e9071347f6a06c9d9c07e548e8/users/3a0185fcb53b4ab0badd98de970d864a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:54.838029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd1bf8-3d73-4e6c-9a65-9ad5e77209d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4365d1e9071347f6a06c9d9c07e548e8, user_id=3a0185fcb53b4ab0badd98de970d864a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:54.842923 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd1bf8-3d73-4e6c-9a65-9ad5e77209d0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:54.858029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 839/1704] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:54 2022] PUT /identity/v3/projects/4365d1e9071347f6a06c9d9c07e548e8/users/3a0185fcb53b4ab0badd98de970d864a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:54.869444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5247d7ff974692af8499ed553ae8e3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.870322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ac2d5e9c-05b4-4cb1-8400-9fa88ea27d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5247d7ff974692af8499ed553ae8e3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:54.888834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f35-9c07-4c11-9310-ac33e91adaa0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:54.890203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 866/1705] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:09:54 2022] DELETE /identity/v3/users/9e5247d7ff974692af8499ed553ae8e3 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:54.893491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f35-9c07-4c11-9310-ac33e91adaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:54.893890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f35-9c07-4c11-9310-ac33e91adaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:54.959352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-904f4f35-9c07-4c11-9310-ac33e91adaa0 None None] MFA Rules not processed for user `3a0185fcb53b4ab0badd98de970d864a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:54.962995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-904f4f35-9c07-4c11-9310-ac33e91adaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:55.025500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:55.050910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d22914-ee19-4970-952e-d6d272da42d3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:55.051545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d22914-ee19-4970-952e-d6d272da42d3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:55.051684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d22914-ee19-4970-952e-d6d272da42d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:55.154444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-08d22914-ee19-4970-952e-d6d272da42d3 None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:55.155810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-08d22914-ee19-4970-952e-d6d272da42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:55.177200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 840/1706] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:55.187538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4f35-9c07-4c11-9310-ac33e91adaa0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:55.189134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-904f4f35-9c07-4c11-9310-ac33e91adaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:55.303595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4f35-9c07-4c11-9310-ac33e91adaa0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:55.309460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264874-9309-416d-ab74-17040948e459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:55.310087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264874-9309-416d-ab74-17040948e459 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:55.310591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264874-9309-416d-ab74-17040948e459 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:55.310865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264874-9309-416d-ab74-17040948e459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:55.326237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75264874-9309-416d-ab74-17040948e459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:55.328108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75264874-9309-416d-ab74-17040948e459 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:55.348623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 867/1707] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:09:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:09:55.355138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 841/1708] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:09:55.765198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d22914-ee19-4970-952e-d6d272da42d3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:55.766751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-08d22914-ee19-4970-952e-d6d272da42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:55.973535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d22914-ee19-4970-952e-d6d272da42d3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:55.981036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:55.981668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:55.981936 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:55.982213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:55.998730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:56.000766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:56.015152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 868/1709] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:09:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:09:56.024700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ea651-e3de-48e2-b822-51e12faedbff None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:56.025219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ea651-e3de-48e2-b822-51e12faedbff None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:56.025403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ea651-e3de-48e2-b822-51e12faedbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:56.062280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bb3ea651-e3de-48e2-b822-51e12faedbff None None] MFA Rules not processed for user `808156c7457b4e8b9b6c5f305755b3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:56.064135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bb3ea651-e3de-48e2-b822-51e12faedbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:56.190193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 842/1710] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:56.238032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:56.240152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:56.343115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:56.471422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9730d-f442-40f9-8fad-05c31cce6966 service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:56.482219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:56.482898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:56.483181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:56.483456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] PATH_INFO: `/v3/projects/8b147e8b476c4e59badeacbd573973ab` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:56.484722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b147e8b476c4e59badeacbd573973ab)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:56.486686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:56.715527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:56.745504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b147e8b476c4e59badeacbd573973ab', 'request_id': 'req-935571a1-8832-4fed-9cf8-0d2f1234b5ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:56.756505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b147e8b476c4e59badeacbd573973ab', 'request_id': 'req-935571a1-8832-4fed-9cf8-0d2f1234b5ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:56.775340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b147e8b476c4e59badeacbd573973ab', 'request_id': 'req-935571a1-8832-4fed-9cf8-0d2f1234b5ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:56.901380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] The token cache is being invalidate because project 8b147e8b476c4e59badeacbd573973ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:09:56.901677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:56.904871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:56.909878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 869/1711] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:09:56 2022] DELETE /identity/v3/projects/8b147e8b476c4e59badeacbd573973ab => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:56.915156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4cc4-3eb8-44e1-a3fb-8bffb4059a81 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:56.915681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4cc4-3eb8-44e1-a3fb-8bffb4059a81 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:56.916147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4cc4-3eb8-44e1-a3fb-8bffb4059a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:56.955198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-622b4cc4-3eb8-44e1-a3fb-8bffb4059a81 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:56.958246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-622b4cc4-3eb8-44e1-a3fb-8bffb4059a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:57.019021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:57.019021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:57.166731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 843/1712] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:57.172552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b562131-639f-4d9a-bf80-b2364d1c6695 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:57.173363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b562131-639f-4d9a-bf80-b2364d1c6695 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:57.176839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b562131-639f-4d9a-bf80-b2364d1c6695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:57.251265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935571a1-8832-4fed-9cf8-0d2f1234b5ee admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:57.252183 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8b562131-639f-4d9a-bf80-b2364d1c6695 None None] MFA Rules not processed for user `fb7200a9769b46b3a79c9fe6287a1724`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:57.253815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8b562131-639f-4d9a-bf80-b2364d1c6695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:57.272599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:57.273652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:57.276754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:57.279722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] PATH_INFO: `/v3/users/e3d367c061d6460e849259dd2f566f44` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:57.281456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d367c061d6460e849259dd2f566f44)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:57.289841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:57.410129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 844/1713] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:57.411688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e43fd6-805e-42b7-8563-7161a6db170a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:57.412074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e43fd6-805e-42b7-8563-7161a6db170a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:57.412449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e43fd6-805e-42b7-8563-7161a6db170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:57.451408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a2e43fd6-805e-42b7-8563-7161a6db170a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:57.453355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a2e43fd6-805e-42b7-8563-7161a6db170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:57.465097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 845/1714] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:57.471799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e43fd6-805e-42b7-8563-7161a6db170a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:57.474536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a2e43fd6-805e-42b7-8563-7161a6db170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:57.505986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e43fd6-805e-42b7-8563-7161a6db170a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:57.518083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:57.519138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:57.519438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:57.520090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] PATH_INFO: `/v3/users/be8107ba4aa844acae23c46773ad9620` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:57.521737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8107ba4aa844acae23c46773ad9620)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:57.524882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:57.546981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d367c061d6460e849259dd2f566f44'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:57.576392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d367c061d6460e849259dd2f566f44'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:57.597230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d367c061d6460e849259dd2f566f44'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.015043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d367c061d6460e849259dd2f566f44'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.016071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d367c061d6460e849259dd2f566f44'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.030602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 870/1715] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:09:57 2022] DELETE /identity/v3/users/e3d367c061d6460e849259dd2f566f44 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:58.031923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:58.037204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:58.068766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8107ba4aa844acae23c46773ad9620'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.083926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8107ba4aa844acae23c46773ad9620'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.119578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8107ba4aa844acae23c46773ad9620'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.181677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a796fe-a868-4037-85e7-0bf01a03f547 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:58.191258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:58.195989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:58.195989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:58.195989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:58.195989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:58.195989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:58.197999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:58.215357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8107ba4aa844acae23c46773ad9620'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.219040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a0257d33-7331-4378-9fab-12f91488f021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8107ba4aa844acae23c46773ad9620'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.227920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 871/1716] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:58.229324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:58.232858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 846/1717] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:09:57 2022] DELETE /identity/v3/users/be8107ba4aa844acae23c46773ad9620 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:58.234167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9820-e438-4897-add7-9dcd29af823b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:58.234468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9820-e438-4897-add7-9dcd29af823b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:58.234753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9820-e438-4897-add7-9dcd29af823b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:58.235920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:58.242369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 847/1718] 10.222.0.75 () {54 vars in 912 bytes} [Mon Sep 19 15:09:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:09:58.244768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494663a1-948c-4bba-ba02-240e87ab68f9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:58.247807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494663a1-948c-4bba-ba02-240e87ab68f9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:58.247807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494663a1-948c-4bba-ba02-240e87ab68f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:58.276500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cc7b-8286-465a-acca-05658bf429c0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:58.339624 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-494663a1-948c-4bba-ba02-240e87ab68f9 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:58.341022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-494663a1-948c-4bba-ba02-240e87ab68f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:58.357019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:58.407720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:58.408754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:58.409248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:58.409726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] PATH_INFO: `/v3/projects/7e21999e725a4f749cfe693a3c183ecb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:58.411187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e21999e725a4f749cfe693a3c183ecb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:58.418551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:58.540771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 848/1719] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:58.541782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494663a1-948c-4bba-ba02-240e87ab68f9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:58.543533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-494663a1-948c-4bba-ba02-240e87ab68f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:58.578331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e21999e725a4f749cfe693a3c183ecb', 'request_id': 'req-8fb6d761-ce6d-4829-939f-e36d6c39ef30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.586401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e21999e725a4f749cfe693a3c183ecb', 'request_id': 'req-8fb6d761-ce6d-4829-939f-e36d6c39ef30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.587186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494663a1-948c-4bba-ba02-240e87ab68f9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:58.606140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e21999e725a4f749cfe693a3c183ecb', 'request_id': 'req-8fb6d761-ce6d-4829-939f-e36d6c39ef30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.711386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] The token cache is being invalidate because project 7e21999e725a4f749cfe693a3c183ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:09:58.713776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.714239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb6d761-ce6d-4829-939f-e36d6c39ef30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:09:58.717880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 872/1720] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:09:58 2022] DELETE /identity/v3/projects/7e21999e725a4f749cfe693a3c183ecb => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:09:58.722205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd98c-0b91-410e-aaad-936fd3db0165 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:58.724040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd98c-0b91-410e-aaad-936fd3db0165 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:58.724524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd98c-0b91-410e-aaad-936fd3db0165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:58.752596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:58.753551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:58.755917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:58.756090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:58.759069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:58.761742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:58.766933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:58.783141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d98cd98c-0b91-410e-aaad-936fd3db0165 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:58.784985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d98cd98c-0b91-410e-aaad-936fd3db0165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:58.811545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 873/1721] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:58.816305 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986c6f-5bdf-405d-9e50-f2940755aab8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:58.816623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986c6f-5bdf-405d-9e50-f2940755aab8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:58.816902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986c6f-5bdf-405d-9e50-f2940755aab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:58.863491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5e986c6f-5bdf-405d-9e50-f2940755aab8 None None] MFA Rules not processed for user `67d0bbf089504d408db0bb7055a780a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:58.867592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5e986c6f-5bdf-405d-9e50-f2940755aab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:58.877805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 849/1722] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:58 2022] POST /identity/v3/projects => generated 377 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:58.878714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:58.883405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:59.005663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 874/1723] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:59.008297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ba38-59eb-4763-844a-772a019fdce6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.008604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ba38-59eb-4763-844a-772a019fdce6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.009036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ba38-59eb-4763-844a-772a019fdce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.052615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8391ba38-59eb-4763-844a-772a019fdce6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:59.058362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8391ba38-59eb-4763-844a-772a019fdce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:59.064839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385d619-7d89-421a-8c88-9aee55865cfe admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.092783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.093467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.093748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.094053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.101911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:59.178095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:59.292528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 875/1724] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:59.293412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391ba38-59eb-4763-844a-772a019fdce6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.316968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.316968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.317803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391ba38-59eb-4763-844a-772a019fdce6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.336894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.337548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.337816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.338089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.343427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 850/1725] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:59.344726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.348809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:59.362866 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.366355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.386648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96239bd9-d1bb-4fd8-b60b-5f95b0308e9d service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.402842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335af0a2-ae74-4388-aa0e-2ba2c8a45d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.402842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af0a2-ae74-4388-aa0e-2ba2c8a45d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.402842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af0a2-ae74-4388-aa0e-2ba2c8a45d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.403064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 876/1726] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:59.403064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.403193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af0a2-ae74-4388-aa0e-2ba2c8a45d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.403973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335af0a2-ae74-4388-aa0e-2ba2c8a45d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.404840 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:59.407172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335af0a2-ae74-4388-aa0e-2ba2c8a45d36 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.448007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c357d-61c8-49c2-9829-014f277536ec service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.463541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8067d-3dbe-4d81-8c98-13343115b96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.464891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8067d-3dbe-4d81-8c98-13343115b96d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.465473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8067d-3dbe-4d81-8c98-13343115b96d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.466018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8067d-3dbe-4d81-8c98-13343115b96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.479859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8067d-3dbe-4d81-8c98-13343115b96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.483578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8067d-3dbe-4d81-8c98-13343115b96d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.509541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 877/1727] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:59.511623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5e6b4-82e5-42d8-bd08-72b4f04c6e6a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.512115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5e6b4-82e5-42d8-bd08-72b4f04c6e6a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.512411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5e6b4-82e5-42d8-bd08-72b4f04c6e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.563662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 851/1728] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:09:59 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:09:59.563825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc5bc-ba8c-4b8a-b69f-9cb3d2969395 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.564011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc5bc-ba8c-4b8a-b69f-9cb3d2969395 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.564298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc5bc-ba8c-4b8a-b69f-9cb3d2969395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.584748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-22d5e6b4-82e5-42d8-bd08-72b4f04c6e6a None None] MFA Rules not processed for user `67d0bbf089504d408db0bb7055a780a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:59.590323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-22d5e6b4-82e5-42d8-bd08-72b4f04c6e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:59.621447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 878/1729] 10.222.0.76 () {58 vars in 1015 bytes} [Mon Sep 19 15:09:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:59.622568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5e6b4-82e5-42d8-bd08-72b4f04c6e6a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.639250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fb8bc5bc-ba8c-4b8a-b69f-9cb3d2969395 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:09:59.642148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fb8bc5bc-ba8c-4b8a-b69f-9cb3d2969395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:09:59.652209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5e6b4-82e5-42d8-bd08-72b4f04c6e6a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.670207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 852/1730] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:09:59.673112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bc5bc-ba8c-4b8a-b69f-9cb3d2969395 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.673932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff14a42-df01-4bb5-a988-dbf501a8c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.675193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff14a42-df01-4bb5-a988-dbf501a8c9fa admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.675479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff14a42-df01-4bb5-a988-dbf501a8c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.675751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff14a42-df01-4bb5-a988-dbf501a8c9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.679197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff14a42-df01-4bb5-a988-dbf501a8c9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.685715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff14a42-df01-4bb5-a988-dbf501a8c9fa admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.700384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 879/1731] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:59.701359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff14a42-df01-4bb5-a988-dbf501a8c9fa admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.707493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:59.709263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bc5bc-ba8c-4b8a-b69f-9cb3d2969395 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.720304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff14a42-df01-4bb5-a988-dbf501a8c9fa admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.725286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ffdc-83d9-4d6b-a702-4cf2060089f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.730625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.731431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ffdc-83d9-4d6b-a702-4cf2060089f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.731431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ffdc-83d9-4d6b-a702-4cf2060089f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.731431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ffdc-83d9-4d6b-a702-4cf2060089f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.731659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.731659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.731659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.731659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:09:59.731659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.736235 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.747282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9ffdc-83d9-4d6b-a702-4cf2060089f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.764363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9ffdc-83d9-4d6b-a702-4cf2060089f2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.782480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:59.786455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 853/1732] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:09:59.787252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.794116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 880/1733] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:09:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:09:59.795400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ffdc-83d9-4d6b-a702-4cf2060089f2 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.810843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3f109-e77b-41ca-bccd-23e62a374908 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.819295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ffdc-83d9-4d6b-a702-4cf2060089f2 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.820523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640ae5c-d79c-4780-8bff-c29d2cede3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.828870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640ae5c-d79c-4780-8bff-c29d2cede3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.828870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640ae5c-d79c-4780-8bff-c29d2cede3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.828870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640ae5c-d79c-4780-8bff-c29d2cede3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.828870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640ae5c-d79c-4780-8bff-c29d2cede3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.828870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640ae5c-d79c-4780-8bff-c29d2cede3c0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.834613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0953f-db70-42e0-b97a-0caff7979a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.835347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0953f-db70-42e0-b97a-0caff7979a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.835823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0953f-db70-42e0-b97a-0caff7979a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.836307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0953f-db70-42e0-b97a-0caff7979a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.836987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0953f-db70-42e0-b97a-0caff7979a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.838913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0953f-db70-42e0-b97a-0caff7979a38 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:09:59.855644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 854/1734] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:09:59.858464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640ae5c-d79c-4780-8bff-c29d2cede3c0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:09:59.911529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640ae5c-d79c-4780-8bff-c29d2cede3c0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:09:59.935081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519bf8d-437d-42bb-b42b-b8978e890740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:09:59.940388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519bf8d-437d-42bb-b42b-b8978e890740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:09:59.940388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519bf8d-437d-42bb-b42b-b8978e890740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:09:59.940388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519bf8d-437d-42bb-b42b-b8978e890740 admin admin] PATH_INFO: `/v3/projects/184ccc20c35445a2a048f630caafd78e/users/9d867f5a9993405b87676d141a88a53a/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:09:59.961316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519bf8d-437d-42bb-b42b-b8978e890740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184ccc20c35445a2a048f630caafd78e, user_id=9d867f5a9993405b87676d141a88a53a, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:09:59.968924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519bf8d-437d-42bb-b42b-b8978e890740 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:00.011000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 881/1735] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:09:59 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:00.018872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0953f-db70-42e0-b97a-0caff7979a38 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:00.063287 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 855/1736] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:09:59 2022] PUT /identity/v3/projects/184ccc20c35445a2a048f630caafd78e/users/9d867f5a9993405b87676d141a88a53a/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:00.076645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4623-dff3-4b47-985a-1ca33e75584f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:00.077612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4623-dff3-4b47-985a-1ca33e75584f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:00.078853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4623-dff3-4b47-985a-1ca33e75584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:00.126744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f0bc4623-dff3-4b47-985a-1ca33e75584f None None] MFA Rules not processed for user `9d867f5a9993405b87676d141a88a53a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:00.128593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f0bc4623-dff3-4b47-985a-1ca33e75584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:00.229943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0953f-db70-42e0-b97a-0caff7979a38 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:00.255112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 856/1737] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:00.261353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc4623-dff3-4b47-985a-1ca33e75584f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:00.369608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c0aed-3096-4e6a-8918-ddd205cc6c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:00.370251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0aed-3096-4e6a-8918-ddd205cc6c48 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:00.370534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0aed-3096-4e6a-8918-ddd205cc6c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:00.370934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0aed-3096-4e6a-8918-ddd205cc6c48 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:00.371649 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c0aed-3096-4e6a-8918-ddd205cc6c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:00.374195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c0aed-3096-4e6a-8918-ddd205cc6c48 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:00.488105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc4623-dff3-4b47-985a-1ca33e75584f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:00.505571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cece092-debd-4910-a1dd-039e748910bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:00.505571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cece092-debd-4910-a1dd-039e748910bd admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:00.505571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cece092-debd-4910-a1dd-039e748910bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:00.505571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cece092-debd-4910-a1dd-039e748910bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:00.505973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cece092-debd-4910-a1dd-039e748910bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:00.505973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cece092-debd-4910-a1dd-039e748910bd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:00.548786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 882/1738] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:00 2022] POST /identity/v3/users => generated 290 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:00.554592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c0aed-3096-4e6a-8918-ddd205cc6c48 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:00.593769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c0aed-3096-4e6a-8918-ddd205cc6c48 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:00.613422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:00.613978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:00.614261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:00.614537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:00.615455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:00.617571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:00.667041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 883/1739] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:00.667667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:00.676345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:00.683373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 857/1740] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:00 2022] POST /identity/v3/projects => generated 375 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:00.685639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cece092-debd-4910-a1dd-039e748910bd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:00.707030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c260c8f-865f-413b-9591-0926d5a07149 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:00.833815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:00.891118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cece092-debd-4910-a1dd-039e748910bd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:00.902321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c551-2630-496f-8d72-a3ecb52d6d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:00.903707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c551-2630-496f-8d72-a3ecb52d6d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:00.904128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c551-2630-496f-8d72-a3ecb52d6d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:00.904658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565c551-2630-496f-8d72-a3ecb52d6d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:00.905521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565c551-2630-496f-8d72-a3ecb52d6d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:00.908151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565c551-2630-496f-8d72-a3ecb52d6d2f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:00.923239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 858/1741] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:00.926318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c551-2630-496f-8d72-a3ecb52d6d2f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:00.930033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:00.930723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:00.931007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:00.931296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] PATH_INFO: `/v3/projects/4a7b06a30986458abf143c857dc5524f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:00.937329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7b06a30986458abf143c857dc5524f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:00.939712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:00.942730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565c551-2630-496f-8d72-a3ecb52d6d2f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:00.947948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:00.955188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c9c5-7bb9-4b57-a939-167ebe2753cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:00.956093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c9c5-7bb9-4b57-a939-167ebe2753cb admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:00.956377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c9c5-7bb9-4b57-a939-167ebe2753cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:00.956692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c9c5-7bb9-4b57-a939-167ebe2753cb admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:00.957333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c9c5-7bb9-4b57-a939-167ebe2753cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:00.959334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c9c5-7bb9-4b57-a939-167ebe2753cb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:01.081680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 859/1742] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:00 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:01.082965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c9c5-7bb9-4b57-a939-167ebe2753cb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:01.129574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c9c5-7bb9-4b57-a939-167ebe2753cb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:01.152360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7b06a30986458abf143c857dc5524f', 'request_id': 'req-1fb931c8-64ca-4794-bd45-8e0736f350f5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:01.173880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7b06a30986458abf143c857dc5524f', 'request_id': 'req-1fb931c8-64ca-4794-bd45-8e0736f350f5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:01.187089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7b06a30986458abf143c857dc5524f', 'request_id': 'req-1fb931c8-64ca-4794-bd45-8e0736f350f5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:01.283655 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:01.284638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:01.284916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:01.285337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] PATH_INFO: `/v3/projects/ded3aec7450b4a2dbf7cc5dfa03e7dfd/users/5728179a70a049d7908b81e0825919fe/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:01.317656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] The token cache is being invalidate because project 4a7b06a30986458abf143c857dc5524f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:01.317965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:01.321469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:01.327027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 884/1743] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:00 2022] DELETE /identity/v3/projects/4a7b06a30986458abf143c857dc5524f => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:01.327027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:01.327250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:01.334438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded3aec7450b4a2dbf7cc5dfa03e7dfd, user_id=5728179a70a049d7908b81e0825919fe, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:01.339185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:01.360344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb931c8-64ca-4794-bd45-8e0736f350f5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:01.373990 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:01.374748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:01.375033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:01.375369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:01.377138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:01.387658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:01.411070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 885/1744] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:01.412012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:01.416300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:01.439274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c98cbe-8e95-4b59-b8e8-e7c4b44147e1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:01.470558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 860/1745] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:01 2022] PUT /identity/v3/projects/ded3aec7450b4a2dbf7cc5dfa03e7dfd/users/5728179a70a049d7908b81e0825919fe/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:01.470558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:01.481907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:01.546395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:01.547345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:01.547803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:01.548085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] PATH_INFO: `/v3/users/0ea6a74df10e44d5b59aa988ee4c602e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:01.549735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea6a74df10e44d5b59aa988ee4c602e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:01.558474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:01.571294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:01.620042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:01.655684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d15a10-18d6-4d6f-a604-41347823acd8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:01.692407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:01.696058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:01.696282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:01.698017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] PATH_INFO: `/v3/projects/bdd9a6347d854dcc9869fa3b16416d15` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:01.701401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd9a6347d854dcc9869fa3b16416d15)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:01.711403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:01.853339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea6a74df10e44d5b59aa988ee4c602e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:01.906306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea6a74df10e44d5b59aa988ee4c602e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:01.919583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea6a74df10e44d5b59aa988ee4c602e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:01.968138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd9a6347d854dcc9869fa3b16416d15', 'request_id': 'req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:02.004450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea6a74df10e44d5b59aa988ee4c602e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:02.006705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea6a74df10e44d5b59aa988ee4c602e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:02.014414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 886/1746] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:01 2022] DELETE /identity/v3/users/0ea6a74df10e44d5b59aa988ee4c602e => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:02.018343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:02.045470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:02.077578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd9a6347d854dcc9869fa3b16416d15', 'request_id': 'req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:02.124155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd9a6347d854dcc9869fa3b16416d15', 'request_id': 'req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:02.165704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] The token cache is being invalidate because project bdd9a6347d854dcc9869fa3b16416d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:02.166166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:02.168030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0ecdaf45-4c7d-4e60-bed1-3aee25951b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:02.181627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 861/1747] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:01 2022] DELETE /identity/v3/projects/bdd9a6347d854dcc9869fa3b16416d15 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:02.183037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616bc67-4e16-4544-b2ac-cac5c4e2fac7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:02.183328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616bc67-4e16-4544-b2ac-cac5c4e2fac7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:02.183609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616bc67-4e16-4544-b2ac-cac5c4e2fac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:02.206224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:02.239863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373896bf-cd91-40b8-8e0c-e59cfa890f4e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:02.253822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:02.254915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:02.255393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:02.255805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] PATH_INFO: `/v3/projects/9c18125ec15b4548a54ab42627c38469/users/4efcb8c88d0f4ecaa61d4762e70e2958/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:02.286582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c18125ec15b4548a54ab42627c38469, user_id=4efcb8c88d0f4ecaa61d4762e70e2958, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:02.290417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:02.300376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d616bc67-4e16-4544-b2ac-cac5c4e2fac7 None None] MFA Rules not processed for user `5728179a70a049d7908b81e0825919fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:02.301677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d616bc67-4e16-4544-b2ac-cac5c4e2fac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:02.396878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 887/1748] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:02 2022] PUT /identity/v3/projects/9c18125ec15b4548a54ab42627c38469/users/4efcb8c88d0f4ecaa61d4762e70e2958/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:02.402897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:02.406564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:02.509038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 862/1749] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:02.509038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616bc67-4e16-4544-b2ac-cac5c4e2fac7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:02.509038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d616bc67-4e16-4544-b2ac-cac5c4e2fac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:02.514426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616bc67-4e16-4544-b2ac-cac5c4e2fac7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:02.647054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:02.672344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:02.673153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:02.673262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42d2fc-d0d5-4866-98e5-67b5753f6226 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:02.673465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:02.673701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:02.674362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:02.676507 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:02.685275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:02.685938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:02.686647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:02.686948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] PATH_INFO: `/v3/users/3a0185fcb53b4ab0badd98de970d864a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:02.701807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 863/1750] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:02.702827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:02.703613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0185fcb53b4ab0badd98de970d864a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:02.707145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:02.708849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:02.735554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d82c9-6162-4e13-b59f-63df539336e3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:02.762669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ab001-d436-44ab-ab8f-42f84eab33dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:02.764226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ab001-d436-44ab-ab8f-42f84eab33dc admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:02.764750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ab001-d436-44ab-ab8f-42f84eab33dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:02.765233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ab001-d436-44ab-ab8f-42f84eab33dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:02.766117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ab001-d436-44ab-ab8f-42f84eab33dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:02.773222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ab001-d436-44ab-ab8f-42f84eab33dc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:02.929654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 864/1751] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:02 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:02.931422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ab001-d436-44ab-ab8f-42f84eab33dc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:03.048070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0185fcb53b4ab0badd98de970d864a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:03.078497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0185fcb53b4ab0badd98de970d864a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:03.096066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ab001-d436-44ab-ab8f-42f84eab33dc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:03.098650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0185fcb53b4ab0badd98de970d864a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:03.125953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20168afa-738f-40bf-96e4-959fd558cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:03.126821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168afa-738f-40bf-96e4-959fd558cb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:03.127082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168afa-738f-40bf-96e4-959fd558cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:03.129998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20168afa-738f-40bf-96e4-959fd558cb4a admin admin] PATH_INFO: `/v3/projects/9c18125ec15b4548a54ab42627c38469/users/4efcb8c88d0f4ecaa61d4762e70e2958/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:03.142269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20168afa-738f-40bf-96e4-959fd558cb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c18125ec15b4548a54ab42627c38469, user_id=4efcb8c88d0f4ecaa61d4762e70e2958, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:03.153560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20168afa-738f-40bf-96e4-959fd558cb4a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:03.186345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 865/1752] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:02 2022] PUT /identity/v3/projects/9c18125ec15b4548a54ab42627c38469/users/4efcb8c88d0f4ecaa61d4762e70e2958/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:03.187538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20168afa-738f-40bf-96e4-959fd558cb4a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:03.202142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0185fcb53b4ab0badd98de970d864a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:03.203072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60a54041-41f8-4c88-bedd-8555480ee287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0185fcb53b4ab0badd98de970d864a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:03.214362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 888/1753] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:02 2022] DELETE /identity/v3/users/3a0185fcb53b4ab0badd98de970d864a => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:03.214362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d2cd-1ff1-45cb-b1ff-470ec7ea7dfe None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:03.214663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d2cd-1ff1-45cb-b1ff-470ec7ea7dfe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:03.215006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d2cd-1ff1-45cb-b1ff-470ec7ea7dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:03.274251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:03.293460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-62b2d2cd-1ff1-45cb-b1ff-470ec7ea7dfe None None] MFA Rules not processed for user `4efcb8c88d0f4ecaa61d4762e70e2958`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:03.298616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-62b2d2cd-1ff1-45cb-b1ff-470ec7ea7dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:03.362866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20168afa-738f-40bf-96e4-959fd558cb4a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:03.519918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 889/1754] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:03.529590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d2cd-1ff1-45cb-b1ff-470ec7ea7dfe None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:03.534935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-62b2d2cd-1ff1-45cb-b1ff-470ec7ea7dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:03.571066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:03.571814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:03.572078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:03.572374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:03.573043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:03.585707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:03.620591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:03.684405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d2cd-1ff1-45cb-b1ff-470ec7ea7dfe None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:03.696824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 866/1755] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:03 2022] POST /identity/v3/users => generated 296 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:03.698388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:03.704348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:03.704568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6469193-338b-44b8-b52d-74beb2852c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:03.705222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469193-338b-44b8-b52d-74beb2852c73 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:03.705572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469193-338b-44b8-b52d-74beb2852c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:03.705853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6469193-338b-44b8-b52d-74beb2852c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:03.707766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a6469193-338b-44b8-b52d-74beb2852c73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:03.789888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e780-b38d-43dd-a154-e3407fe30b28 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:03.798736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dccd13-2d04-456d-9d94-b343945d2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:03.799781 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dccd13-2d04-456d-9d94-b343945d2bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:03.800065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dccd13-2d04-456d-9d94-b343945d2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:03.800341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dccd13-2d04-456d-9d94-b343945d2bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:03.801074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dccd13-2d04-456d-9d94-b343945d2bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:03.803232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dccd13-2d04-456d-9d94-b343945d2bd4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:03.822706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 867/1756] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:03.824150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f558c-bf40-44c0-b6bc-2a07889f93dc None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:03.824442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f558c-bf40-44c0-b6bc-2a07889f93dc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:03.825173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f558c-bf40-44c0-b6bc-2a07889f93dc None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:03.828618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 868/1757] 10.222.0.75 () {54 vars in 921 bytes} [Mon Sep 19 15:10:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:10:03.831701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f558c-bf40-44c0-b6bc-2a07889f93dc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:03.840822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6469193-338b-44b8-b52d-74beb2852c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:03.844307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6469193-338b-44b8-b52d-74beb2852c73 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:03.878410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 890/1758] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:03.890389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f558c-bf40-44c0-b6bc-2a07889f93dc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:03.896854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:03.898268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:03.898950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:03.899615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] PATH_INFO: `/v3/projects/747e2dddd44c407986b96a21836999aa/users/ce5811ebd0e14f3c93e7843dc0fc5e53/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:03.919347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf229f0-05f7-481c-a357-aeacfa85a119 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:03.920057 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf229f0-05f7-481c-a357-aeacfa85a119 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:03.920341 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf229f0-05f7-481c-a357-aeacfa85a119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:03.940625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747e2dddd44c407986b96a21836999aa, user_id=ce5811ebd0e14f3c93e7843dc0fc5e53, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:03.940625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:03.972640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ccf229f0-05f7-481c-a357-aeacfa85a119 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:03.976386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ccf229f0-05f7-481c-a357-aeacfa85a119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:04.047632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 869/1759] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:03 2022] PUT /identity/v3/projects/747e2dddd44c407986b96a21836999aa/users/ce5811ebd0e14f3c93e7843dc0fc5e53/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:04.049782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:04.075708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:04.189946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:04.247676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 891/1760] 10.222.0.75 () {58 vars in 1018 bytes} [Mon Sep 19 15:10:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:04.249165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf229f0-05f7-481c-a357-aeacfa85a119 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:04.271721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf229f0-05f7-481c-a357-aeacfa85a119 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:04.339948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3292315-19f0-4964-bec4-ca3329fd93d1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:04.347589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:04.349591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:04.350395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:04.351134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] PATH_INFO: `/v3/projects/780095a8ce1b4407bad8fc2e8352c9b8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:04.352888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780095a8ce1b4407bad8fc2e8352c9b8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:04.356822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:04.432364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:04.433700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:04.433700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:04.433878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:04.434388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:04.436524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:04.451933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 892/1761] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:04.452784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:04.454621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:04.585863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780095a8ce1b4407bad8fc2e8352c9b8', 'request_id': 'req-eba8f197-750c-4a8c-9b51-129b029bc677'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:04.715983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebea1b-0f3d-48d9-ae02-e983093174af admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:04.735571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780095a8ce1b4407bad8fc2e8352c9b8', 'request_id': 'req-eba8f197-750c-4a8c-9b51-129b029bc677'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:04.746993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780095a8ce1b4407bad8fc2e8352c9b8', 'request_id': 'req-eba8f197-750c-4a8c-9b51-129b029bc677'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:04.769084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] The token cache is being invalidate because project 780095a8ce1b4407bad8fc2e8352c9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:04.769366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:04.770043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:04.771880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 870/1762] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:04 2022] DELETE /identity/v3/projects/780095a8ce1b4407bad8fc2e8352c9b8 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:04.773370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:04.774772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:04.882485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:04.888159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:04.888852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:04.889498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:04.889785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:04.909297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:04.927092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8f197-750c-4a8c-9b51-129b029bc677 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:04.930666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:04.932289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:04.958826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:04.963180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 893/1763] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:04.964049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:04.967168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:04.967492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cacd8-5881-48de-8345-ae652af27c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:04.969589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cacd8-5881-48de-8345-ae652af27c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:04.972421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cacd8-5881-48de-8345-ae652af27c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:04.974690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cacd8-5881-48de-8345-ae652af27c30 admin admin] PATH_INFO: `/v3/projects/747e2dddd44c407986b96a21836999aa/users/ce5811ebd0e14f3c93e7843dc0fc5e53/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:04.987416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cacd8-5881-48de-8345-ae652af27c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747e2dddd44c407986b96a21836999aa, user_id=ce5811ebd0e14f3c93e7843dc0fc5e53, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:04.997424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e442492-5049-4e24-ba70-cbf9eb288726 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:05.018531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cacd8-5881-48de-8345-ae652af27c30 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:05.018613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:05.018613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.018613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.018613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] PATH_INFO: `/v3/projects/4365d1e9071347f6a06c9d9c07e548e8` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.018878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4365d1e9071347f6a06c9d9c07e548e8)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:05.018878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:05.052029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 871/1764] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:04 2022] PUT /identity/v3/projects/747e2dddd44c407986b96a21836999aa/users/ce5811ebd0e14f3c93e7843dc0fc5e53/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:05.055480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa659571-4233-49ca-af7c-8570c4318447 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.055777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa659571-4233-49ca-af7c-8570c4318447 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.056060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa659571-4233-49ca-af7c-8570c4318447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.148373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-aa659571-4233-49ca-af7c-8570c4318447 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:05.156135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aa659571-4233-49ca-af7c-8570c4318447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:05.299154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4365d1e9071347f6a06c9d9c07e548e8', 'request_id': 'req-b0060259-d2b6-4fb1-b656-fa5330199f16'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:05.345439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4365d1e9071347f6a06c9d9c07e548e8', 'request_id': 'req-b0060259-d2b6-4fb1-b656-fa5330199f16'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:05.362031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4365d1e9071347f6a06c9d9c07e548e8', 'request_id': 'req-b0060259-d2b6-4fb1-b656-fa5330199f16'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:05.364355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 872/1765] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:05.366772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e8be4-00b9-4511-9f3c-97939c5d6a62 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.367232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e8be4-00b9-4511-9f3c-97939c5d6a62 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.367894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e8be4-00b9-4511-9f3c-97939c5d6a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.453408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-895e8be4-00b9-4511-9f3c-97939c5d6a62 None None] MFA Rules not processed for user `ce5811ebd0e14f3c93e7843dc0fc5e53`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:05.454892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-895e8be4-00b9-4511-9f3c-97939c5d6a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:05.455918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] The token cache is being invalidate because project 4365d1e9071347f6a06c9d9c07e548e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:05.456761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:05.461597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0060259-d2b6-4fb1-b656-fa5330199f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:05.474282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 894/1766] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:04 2022] DELETE /identity/v3/projects/4365d1e9071347f6a06c9d9c07e548e8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:05.474282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8ae4-a7d1-4dd5-95e5-5f3b3387e2d6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.474282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8ae4-a7d1-4dd5-95e5-5f3b3387e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.474282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8ae4-a7d1-4dd5-95e5-5f3b3387e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.511407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-16ef8ae4-a7d1-4dd5-95e5-5f3b3387e2d6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:05.512807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-16ef8ae4-a7d1-4dd5-95e5-5f3b3387e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:05.647140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 873/1767] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:05.647140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbfc48-070e-40bf-a591-9926ecbfbb6f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.647140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbfc48-070e-40bf-a591-9926ecbfbb6f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.647140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbfc48-070e-40bf-a591-9926ecbfbb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.683191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b6cbfc48-070e-40bf-a591-9926ecbfbb6f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:05.684741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b6cbfc48-070e-40bf-a591-9926ecbfbb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:05.698791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 895/1768] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:05.705567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef8ae4-a7d1-4dd5-95e5-5f3b3387e2d6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:05.705567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-16ef8ae4-a7d1-4dd5-95e5-5f3b3387e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:05.706577 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 874/1769] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:05.707879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbfc48-070e-40bf-a591-9926ecbfbb6f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:05.737900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbfc48-070e-40bf-a591-9926ecbfbb6f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:05.752233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b096be-2be8-47d5-93e2-1b71fb60fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:05.756080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b096be-2be8-47d5-93e2-1b71fb60fbec admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.760752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b096be-2be8-47d5-93e2-1b71fb60fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.761289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b096be-2be8-47d5-93e2-1b71fb60fbec admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.762234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b096be-2be8-47d5-93e2-1b71fb60fbec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:05.764140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b096be-2be8-47d5-93e2-1b71fb60fbec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:05.765947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b096be-2be8-47d5-93e2-1b71fb60fbec admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:05.805102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 875/1770] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:05.805102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3fc6-906b-42bb-8360-af32233e01f2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.805102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3fc6-906b-42bb-8360-af32233e01f2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.805102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3fc6-906b-42bb-8360-af32233e01f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.865822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef8ae4-a7d1-4dd5-95e5-5f3b3387e2d6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:05.879478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9992a-c309-4de7-a811-10de12e4a8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:05.880120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9992a-c309-4de7-a811-10de12e4a8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.880407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9992a-c309-4de7-a811-10de12e4a8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.880711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9992a-c309-4de7-a811-10de12e4a8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.892001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a67d3fc6-906b-42bb-8360-af32233e01f2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:05.897917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a67d3fc6-906b-42bb-8360-af32233e01f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:05.909664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9992a-c309-4de7-a811-10de12e4a8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:05.911696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9992a-c309-4de7-a811-10de12e4a8a1 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:05.921999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 876/1771] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:05.925784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3fc6-906b-42bb-8360-af32233e01f2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:05.940465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 896/1772] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:05.950093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9992a-c309-4de7-a811-10de12e4a8a1 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:05.955107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3fc6-906b-42bb-8360-af32233e01f2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:05.969086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947143-2cd4-4e9c-ae9b-97fce82884aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:05.969826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947143-2cd4-4e9c-ae9b-97fce82884aa admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.970118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947143-2cd4-4e9c-ae9b-97fce82884aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.970437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947143-2cd4-4e9c-ae9b-97fce82884aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.971052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947143-2cd4-4e9c-ae9b-97fce82884aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:05.973922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9992a-c309-4de7-a811-10de12e4a8a1 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:05.974710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947143-2cd4-4e9c-ae9b-97fce82884aa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:05.981318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:05.981944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:05.982233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:05.982515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:05.983235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:05.983553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:05.985277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:05.999589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 897/1773] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:06.003864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.025224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368ea6e-91a2-4f94-adc1-1f9d5945f6d0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.030770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347313c1-a6bd-42ff-85d1-ebf9184bc5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.031448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347313c1-a6bd-42ff-85d1-ebf9184bc5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.031731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347313c1-a6bd-42ff-85d1-ebf9184bc5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.032000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347313c1-a6bd-42ff-85d1-ebf9184bc5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.032797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347313c1-a6bd-42ff-85d1-ebf9184bc5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.034723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347313c1-a6bd-42ff-85d1-ebf9184bc5c3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.052203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:06.096249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 877/1774] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:05 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:06.100003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947143-2cd4-4e9c-ae9b-97fce82884aa admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.145862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:06.146354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 898/1775] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:06 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:10:06.150970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347313c1-a6bd-42ff-85d1-ebf9184bc5c3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.325468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947143-2cd4-4e9c-ae9b-97fce82884aa admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.346888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb51019-d465-4d22-8705-5f386b71b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.349923 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51019-d465-4d22-8705-5f386b71b4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.351917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51019-d465-4d22-8705-5f386b71b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.353495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51019-d465-4d22-8705-5f386b71b4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.355106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb51019-d465-4d22-8705-5f386b71b4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.358812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347313c1-a6bd-42ff-85d1-ebf9184bc5c3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.360367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb51019-d465-4d22-8705-5f386b71b4c5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.372367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1c807-df71-4304-b2cd-fb5abfb27a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.373709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1c807-df71-4304-b2cd-fb5abfb27a4a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.374003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1c807-df71-4304-b2cd-fb5abfb27a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.374283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1c807-df71-4304-b2cd-fb5abfb27a4a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.374933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1c807-df71-4304-b2cd-fb5abfb27a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.384473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1c807-df71-4304-b2cd-fb5abfb27a4a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.488460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 899/1776] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:06 2022] POST /identity/v3/users => generated 285 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:06.493909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1c807-df71-4304-b2cd-fb5abfb27a4a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.512801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1c807-df71-4304-b2cd-fb5abfb27a4a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.520859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e48dbd-0803-49e2-81fa-1c7ac0a30658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.520859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e48dbd-0803-49e2-81fa-1c7ac0a30658 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.520859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e48dbd-0803-49e2-81fa-1c7ac0a30658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.520859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e48dbd-0803-49e2-81fa-1c7ac0a30658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.528947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e48dbd-0803-49e2-81fa-1c7ac0a30658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.529132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 878/1777] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:06 2022] POST /identity/v3/users => generated 287 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:06.529281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e48dbd-0803-49e2-81fa-1c7ac0a30658 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.535802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb51019-d465-4d22-8705-5f386b71b4c5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.552258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 900/1778] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:06.557108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e48dbd-0803-49e2-81fa-1c7ac0a30658 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.582051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e48dbd-0803-49e2-81fa-1c7ac0a30658 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.587770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb51019-d465-4d22-8705-5f386b71b4c5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.595479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be9e9-a605-49bc-83e3-9a563f8a4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.597954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be9e9-a605-49bc-83e3-9a563f8a4e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.597954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be9e9-a605-49bc-83e3-9a563f8a4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.597954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be9e9-a605-49bc-83e3-9a563f8a4e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.597954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960be9e9-a605-49bc-83e3-9a563f8a4e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.602146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960be9e9-a605-49bc-83e3-9a563f8a4e87 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.604013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af312b-586a-4299-bdaf-f8e045e2b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.604779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af312b-586a-4299-bdaf-f8e045e2b42d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.605231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af312b-586a-4299-bdaf-f8e045e2b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.605609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af312b-586a-4299-bdaf-f8e045e2b42d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.606562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af312b-586a-4299-bdaf-f8e045e2b42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.612573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af312b-586a-4299-bdaf-f8e045e2b42d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.625785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 901/1779] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:10:06.632639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be9e9-a605-49bc-83e3-9a563f8a4e87 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.641318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 879/1780] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:06.643547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af312b-586a-4299-bdaf-f8e045e2b42d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.650708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be9e9-a605-49bc-83e3-9a563f8a4e87 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.662287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01d27e-28be-497b-8900-a5168488d54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.663650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d27e-28be-497b-8900-a5168488d54c admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.663947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d27e-28be-497b-8900-a5168488d54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.664284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d27e-28be-497b-8900-a5168488d54c admin admin] PATH_INFO: `/v3/projects/303f2f0c7d874762976ed31381e28745/users/54c45cdfd1254ee1bf83f52ef781c8b0/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.666002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af312b-586a-4299-bdaf-f8e045e2b42d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.681293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750a0a-f628-404d-a1b7-94abc4c3fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.682252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750a0a-f628-404d-a1b7-94abc4c3fde0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.682831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750a0a-f628-404d-a1b7-94abc4c3fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.683149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750a0a-f628-404d-a1b7-94abc4c3fde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.683441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01d27e-28be-497b-8900-a5168488d54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=303f2f0c7d874762976ed31381e28745, user_id=54c45cdfd1254ee1bf83f52ef781c8b0, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.683984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750a0a-f628-404d-a1b7-94abc4c3fde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.686029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750a0a-f628-404d-a1b7-94abc4c3fde0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.686286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01d27e-28be-497b-8900-a5168488d54c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.717844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 880/1781] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:06.718897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750a0a-f628-404d-a1b7-94abc4c3fde0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.731307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750a0a-f628-404d-a1b7-94abc4c3fde0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:06.738951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:06.740192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.741997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.742380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] PATH_INFO: `/v3/projects/761b3787292e49059e186dd70b56449c/users/3044abd6e1d84ef8bb2c1c6589911c32/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.759984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 902/1782] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:06 2022] PUT /identity/v3/projects/303f2f0c7d874762976ed31381e28745/users/54c45cdfd1254ee1bf83f52ef781c8b0/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:06.770682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c7cb4-ebd1-4787-84c4-f8dcd558dbfd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:06.770857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c7cb4-ebd1-4787-84c4-f8dcd558dbfd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:06.771113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c7cb4-ebd1-4787-84c4-f8dcd558dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:06.812757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=761b3787292e49059e186dd70b56449c, user_id=3044abd6e1d84ef8bb2c1c6589911c32, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:06.815800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:06.831980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e89c7cb4-ebd1-4787-84c4-f8dcd558dbfd None None] MFA Rules not processed for user `54c45cdfd1254ee1bf83f52ef781c8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:06.833286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e89c7cb4-ebd1-4787-84c4-f8dcd558dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:06.927211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 881/1783] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:06 2022] PUT /identity/v3/projects/761b3787292e49059e186dd70b56449c/users/3044abd6e1d84ef8bb2c1c6589911c32/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:06.938008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:06.940980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:07.041613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca6102-fc68-4609-a723-cb1d885e27fa admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:07.050176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:07.050980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:07.051354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:07.051901 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] PATH_INFO: `/v3/users/5728179a70a049d7908b81e0825919fe` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:07.053355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5728179a70a049d7908b81e0825919fe)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:07.055431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:07.114710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 903/1784] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:07.116318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30f113-13dd-48b0-86f3-7b0936cd4809 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:07.116318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30f113-13dd-48b0-86f3-7b0936cd4809 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:07.116637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30f113-13dd-48b0-86f3-7b0936cd4809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:07.200994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1e30f113-13dd-48b0-86f3-7b0936cd4809 None None] MFA Rules not processed for user `3044abd6e1d84ef8bb2c1c6589911c32`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:07.202304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1e30f113-13dd-48b0-86f3-7b0936cd4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:07.234915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:07.301116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5728179a70a049d7908b81e0825919fe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:07.337606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5728179a70a049d7908b81e0825919fe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:07.363673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:07.377003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5728179a70a049d7908b81e0825919fe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:07.420507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 904/1785] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:07.424546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30f113-13dd-48b0-86f3-7b0936cd4809 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:07.456119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30f113-13dd-48b0-86f3-7b0936cd4809 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:07.479287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6da32b-20b1-43a4-b1ba-abf79def17ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:07.480041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da32b-20b1-43a4-b1ba-abf79def17ad admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:07.480667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da32b-20b1-43a4-b1ba-abf79def17ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:07.481175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da32b-20b1-43a4-b1ba-abf79def17ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:07.481896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6da32b-20b1-43a4-b1ba-abf79def17ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:07.484008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6da32b-20b1-43a4-b1ba-abf79def17ad admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:07.522844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5728179a70a049d7908b81e0825919fe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:07.523658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5728179a70a049d7908b81e0825919fe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:07.534881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 882/1786] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:06 2022] DELETE /identity/v3/users/5728179a70a049d7908b81e0825919fe => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:07.535311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:07.555318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:07.620860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 905/1787] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:07 2022] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:07.620860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405005f-d9f2-4d90-ba5a-24f985385c5e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:07.620860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405005f-d9f2-4d90-ba5a-24f985385c5e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:07.622946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405005f-d9f2-4d90-ba5a-24f985385c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:07.654312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9405005f-d9f2-4d90-ba5a-24f985385c5e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:07.656083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9405005f-d9f2-4d90-ba5a-24f985385c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:07.690186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838f04a-aff6-4c99-a48e-c9bf5df2afa3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:07.795275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:07.796029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:07.796432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:07.796858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:07.797774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:07.801072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:07.822592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 906/1788] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:07.842650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405005f-d9f2-4d90-ba5a-24f985385c5e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:07.845629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9405005f-d9f2-4d90-ba5a-24f985385c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:07.864016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405005f-d9f2-4d90-ba5a-24f985385c5e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:07.898203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52ab21-9b34-46ff-a566-f2e949823bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:07.899475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52ab21-9b34-46ff-a566-f2e949823bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:07.900249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52ab21-9b34-46ff-a566-f2e949823bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:07.900749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52ab21-9b34-46ff-a566-f2e949823bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:07.918759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52ab21-9b34-46ff-a566-f2e949823bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:07.934451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52ab21-9b34-46ff-a566-f2e949823bc0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:07.937004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 883/1789] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:07 2022] POST /identity/v3/projects => generated 373 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:07.938339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:07.949244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:08.072413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d966f-183e-42fe-a996-2c4e03f9c9f1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:08.094317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 907/1790] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:07 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:08.095345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52ab21-9b34-46ff-a566-f2e949823bc0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:08.130467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7f294-380d-4e5a-9643-bc635ecd714e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:08.135471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f294-380d-4e5a-9643-bc635ecd714e service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.135763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f294-380d-4e5a-9643-bc635ecd714e service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.136044 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7f294-380d-4e5a-9643-bc635ecd714e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.170999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52ab21-9b34-46ff-a566-f2e949823bc0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:08.399911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7f294-380d-4e5a-9643-bc635ecd714e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:08.407073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7f294-380d-4e5a-9643-bc635ecd714e service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:08.409709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb61bf-e2fd-4194-bf43-570ee094b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:08.410858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb61bf-e2fd-4194-bf43-570ee094b32e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.411196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb61bf-e2fd-4194-bf43-570ee094b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.411529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb61bf-e2fd-4194-bf43-570ee094b32e admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.412256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb61bf-e2fd-4194-bf43-570ee094b32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:08.426386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb61bf-e2fd-4194-bf43-570ee094b32e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:08.431532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 884/1791] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:08.432143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7f294-380d-4e5a-9643-bc635ecd714e service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:08.447349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7f294-380d-4e5a-9643-bc635ecd714e service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:08.455801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00322-9912-4c54-9057-0b3fc61ec960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:08.458487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00322-9912-4c54-9057-0b3fc61ec960 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.459224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00322-9912-4c54-9057-0b3fc61ec960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.459764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00322-9912-4c54-9057-0b3fc61ec960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.461621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00322-9912-4c54-9057-0b3fc61ec960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:08.463865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00322-9912-4c54-9057-0b3fc61ec960 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:08.478321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 885/1792] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:08.482254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00322-9912-4c54-9057-0b3fc61ec960 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:08.502768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00322-9912-4c54-9057-0b3fc61ec960 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:08.513108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1276-f468-4b7f-90c5-efe9ebbf389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:08.514621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1276-f468-4b7f-90c5-efe9ebbf389e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.515087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1276-f468-4b7f-90c5-efe9ebbf389e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.515664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f1276-f468-4b7f-90c5-efe9ebbf389e admin admin] PATH_INFO: `/v3/projects/9ce1ac0adbbd4624bb3694846cfe9e75/users/903502471da74753960cd5134e62c88f/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.554586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1276-f468-4b7f-90c5-efe9ebbf389e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce1ac0adbbd4624bb3694846cfe9e75, user_id=903502471da74753960cd5134e62c88f, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:08.558656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f1276-f468-4b7f-90c5-efe9ebbf389e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:08.568747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 908/1793] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:08 2022] POST /identity/v3/users => generated 293 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:08.580949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb61bf-e2fd-4194-bf43-570ee094b32e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:08.591995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:08.597342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb61bf-e2fd-4194-bf43-570ee094b32e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:08.604175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc7fec-39d5-416d-b645-62e7f3f1bc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:08.605276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7fec-39d5-416d-b645-62e7f3f1bc1c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.605913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7fec-39d5-416d-b645-62e7f3f1bc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.606524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc7fec-39d5-416d-b645-62e7f3f1bc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.607571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc7fec-39d5-416d-b645-62e7f3f1bc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:08.609596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc7fec-39d5-416d-b645-62e7f3f1bc1c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:08.628531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 886/1794] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:08 2022] PUT /identity/v3/projects/9ce1ac0adbbd4624bb3694846cfe9e75/users/903502471da74753960cd5134e62c88f/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:08.630977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 909/1795] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:08.633747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1276-f468-4b7f-90c5-efe9ebbf389e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:08.638019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc7fec-39d5-416d-b645-62e7f3f1bc1c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:08.663358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc7fec-39d5-416d-b645-62e7f3f1bc1c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:08.737635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:08.757261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f1276-f468-4b7f-90c5-efe9ebbf389e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:08.767195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895da73-8b6d-4658-be7a-827624891646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:08.768179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895da73-8b6d-4658-be7a-827624891646 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.768592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895da73-8b6d-4658-be7a-827624891646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.768934 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895da73-8b6d-4658-be7a-827624891646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.769840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895da73-8b6d-4658-be7a-827624891646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:08.771527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895da73-8b6d-4658-be7a-827624891646 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:08.797687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b5f27-58e2-42d4-a292-21ad9dbb3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:08.798440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b5f27-58e2-42d4-a292-21ad9dbb3464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.798720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b5f27-58e2-42d4-a292-21ad9dbb3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.798999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b5f27-58e2-42d4-a292-21ad9dbb3464 admin admin] PATH_INFO: `/v3/projects/a59f9ca864fd457291f17ace57a20dc0/users/16c8ca80fec840559dcd06fc159abd80/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.821432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 887/1796] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:08.823007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895da73-8b6d-4658-be7a-827624891646 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:08.834215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895da73-8b6d-4658-be7a-827624891646 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:08.842694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af517fa-730d-4eae-bcf2-474cee058829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:08.843629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af517fa-730d-4eae-bcf2-474cee058829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.844158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af517fa-730d-4eae-bcf2-474cee058829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.844724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af517fa-730d-4eae-bcf2-474cee058829 admin admin] PATH_INFO: `/v3/projects/9ce1ac0adbbd4624bb3694846cfe9e75/users/903502471da74753960cd5134e62c88f/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.846975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af517fa-730d-4eae-bcf2-474cee058829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce1ac0adbbd4624bb3694846cfe9e75, user_id=903502471da74753960cd5134e62c88f, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:08.851357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b5f27-58e2-42d4-a292-21ad9dbb3464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59f9ca864fd457291f17ace57a20dc0, user_id=16c8ca80fec840559dcd06fc159abd80, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:08.851977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af517fa-730d-4eae-bcf2-474cee058829 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:08.855629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b5f27-58e2-42d4-a292-21ad9dbb3464 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:08.871031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 888/1797] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:08 2022] PUT /identity/v3/projects/9ce1ac0adbbd4624bb3694846cfe9e75/users/903502471da74753960cd5134e62c88f/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:08.882744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2568-f4c9-4108-a58a-358868a3fd19 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:08.883092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2568-f4c9-4108-a58a-358868a3fd19 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:08.883621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2568-f4c9-4108-a58a-358868a3fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:08.929726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-750e2568-f4c9-4108-a58a-358868a3fd19 None None] MFA Rules not processed for user `903502471da74753960cd5134e62c88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:08.931735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-750e2568-f4c9-4108-a58a-358868a3fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:08.968752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 910/1798] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:08 2022] PUT /identity/v3/projects/a59f9ca864fd457291f17ace57a20dc0/users/16c8ca80fec840559dcd06fc159abd80/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:08.973250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b5f27-58e2-42d4-a292-21ad9dbb3464 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:09.071217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 889/1799] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:09.092640 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e2568-f4c9-4108-a58a-358868a3fd19 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:09.094886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-750e2568-f4c9-4108-a58a-358868a3fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:09.136799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b5f27-58e2-42d4-a292-21ad9dbb3464 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:09.143676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a858-403c-41fe-b252-1b31feaeb6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:09.154420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a858-403c-41fe-b252-1b31feaeb6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:09.154420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a858-403c-41fe-b252-1b31feaeb6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:09.154420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a858-403c-41fe-b252-1b31feaeb6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:09.154420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6a858-403c-41fe-b252-1b31feaeb6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:09.154420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6a858-403c-41fe-b252-1b31feaeb6ea admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:09.182969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 911/1800] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:09.188970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a858-403c-41fe-b252-1b31feaeb6ea admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:09.213241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e2568-f4c9-4108-a58a-358868a3fd19 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:09.216939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a858-403c-41fe-b252-1b31feaeb6ea admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:09.227349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8ac83-735b-4bc2-849a-52b2690d9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:09.228062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8ac83-735b-4bc2-849a-52b2690d9dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:09.228360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8ac83-735b-4bc2-849a-52b2690d9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:09.228606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8ac83-735b-4bc2-849a-52b2690d9dfe admin admin] PATH_INFO: `/v3/projects/a59f9ca864fd457291f17ace57a20dc0/users/16c8ca80fec840559dcd06fc159abd80/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:09.238340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8ac83-735b-4bc2-849a-52b2690d9dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59f9ca864fd457291f17ace57a20dc0, user_id=16c8ca80fec840559dcd06fc159abd80, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:09.241591 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8ac83-735b-4bc2-849a-52b2690d9dfe admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:09.279189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 912/1801] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:09 2022] PUT /identity/v3/projects/a59f9ca864fd457291f17ace57a20dc0/users/16c8ca80fec840559dcd06fc159abd80/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:09.280782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad895eb-8d40-4e2f-a60c-024f25e77c24 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:09.282508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:09.284546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad895eb-8d40-4e2f-a60c-024f25e77c24 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:09.284820 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad895eb-8d40-4e2f-a60c-024f25e77c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:09.366970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3ad895eb-8d40-4e2f-a60c-024f25e77c24 None None] MFA Rules not processed for user `16c8ca80fec840559dcd06fc159abd80`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:09.368940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ad895eb-8d40-4e2f-a60c-024f25e77c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:09.390373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6acad-739e-4439-9438-c84991ee824f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:09.391011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6acad-739e-4439-9438-c84991ee824f service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:09.391295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6acad-739e-4439-9438-c84991ee824f service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:09.391570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6acad-739e-4439-9438-c84991ee824f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:09.446798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:09.520470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6acad-739e-4439-9438-c84991ee824f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:09.525756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 913/1802] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:09.527444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4af6-6089-426c-9966-23770cd1a34a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:09.527735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4af6-6089-426c-9966-23770cd1a34a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:09.528012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa4af6-6089-426c-9966-23770cd1a34a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:09.537545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6acad-739e-4439-9438-c84991ee824f service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:09.540336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 914/1803] 10.222.0.75 () {54 vars in 921 bytes} [Mon Sep 19 15:10:09 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:10:09.541223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa4af6-6089-426c-9966-23770cd1a34a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:09.548745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a7aa4af6-6089-426c-9966-23770cd1a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:09.559740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 890/1804] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:09.561294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f3cc8-1dbd-4546-8032-172c6318a276 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:09.561559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f3cc8-1dbd-4546-8032-172c6318a276 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:09.567334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f3cc8-1dbd-4546-8032-172c6318a276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:09.626425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f05f3cc8-1dbd-4546-8032-172c6318a276 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:09.627904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f05f3cc8-1dbd-4546-8032-172c6318a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:09.694529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa4af6-6089-426c-9966-23770cd1a34a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:09.705885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:09.706520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:09.706799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:09.707070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:09.716103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:09.729812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:09.731340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:09.734502 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 891/1805] 10.222.0.75 () {58 vars in 1018 bytes} [Mon Sep 19 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:09.757507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 915/1806] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:09.867893 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f3cc8-1dbd-4546-8032-172c6318a276 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:09.869706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f05f3cc8-1dbd-4546-8032-172c6318a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:09.894547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f3cc8-1dbd-4546-8032-172c6318a276 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:09.902686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56815-adcb-4a38-9ec0-a5c719ed54c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:09.903387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56815-adcb-4a38-9ec0-a5c719ed54c0 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:09.903803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56815-adcb-4a38-9ec0-a5c719ed54c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:09.904208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56815-adcb-4a38-9ec0-a5c719ed54c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:09.920184 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56815-adcb-4a38-9ec0-a5c719ed54c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:09.921989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56815-adcb-4a38-9ec0-a5c719ed54c0 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:09.945434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 892/1807] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:10.040521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:10.042118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:10.182596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679e1cc-b085-4c64-9fc3-77beb14159fb service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:10.196805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:10.197487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:10.197776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:10.198059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] PATH_INFO: `/v3/projects/ded3aec7450b4a2dbf7cc5dfa03e7dfd` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:10.201359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded3aec7450b4a2dbf7cc5dfa03e7dfd)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:10.203992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:10.402934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded3aec7450b4a2dbf7cc5dfa03e7dfd', 'request_id': 'req-3bc449b4-2b60-49c7-8367-9013eb707f5d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.413485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded3aec7450b4a2dbf7cc5dfa03e7dfd', 'request_id': 'req-3bc449b4-2b60-49c7-8367-9013eb707f5d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.421200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded3aec7450b4a2dbf7cc5dfa03e7dfd', 'request_id': 'req-3bc449b4-2b60-49c7-8367-9013eb707f5d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.517963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] The token cache is being invalidate because project ded3aec7450b4a2dbf7cc5dfa03e7dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:10.518416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.519083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.520708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 916/1808] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:10 2022] DELETE /identity/v3/projects/ded3aec7450b4a2dbf7cc5dfa03e7dfd => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:10.525309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56815-adcb-4a38-9ec0-a5c719ed54c0 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:10.536716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56815-adcb-4a38-9ec0-a5c719ed54c0 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:10.606076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:10.606712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:10.606998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:10.607301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] PATH_INFO: `/v3/users/ce5811ebd0e14f3c93e7843dc0fc5e53` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:10.608468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5811ebd0e14f3c93e7843dc0fc5e53)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:10.610440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:10.852541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5811ebd0e14f3c93e7843dc0fc5e53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.859641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5811ebd0e14f3c93e7843dc0fc5e53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.872431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5811ebd0e14f3c93e7843dc0fc5e53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.981371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5811ebd0e14f3c93e7843dc0fc5e53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.984330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5811ebd0e14f3c93e7843dc0fc5e53'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:10.992748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 893/1809] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:10 2022] DELETE /identity/v3/users/ce5811ebd0e14f3c93e7843dc0fc5e53 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:11.101269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:11.103070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:11.119202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc449b4-2b60-49c7-8367-9013eb707f5d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:11.135272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:11.189041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:11.189733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:11.190016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:11.190292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] PATH_INFO: `/v3/users/3044abd6e1d84ef8bb2c1c6589911c32` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:11.191519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3044abd6e1d84ef8bb2c1c6589911c32)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:11.193588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:11.455846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3044abd6e1d84ef8bb2c1c6589911c32'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.469361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3044abd6e1d84ef8bb2c1c6589911c32'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.478467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3044abd6e1d84ef8bb2c1c6589911c32'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.543304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:11.544868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:11.559439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9815665-6757-4890-a4d5-22f8aec57f0b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:11.565251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3044abd6e1d84ef8bb2c1c6589911c32'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.565534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0adeaa8-ede6-49d4-8552-e1f2cf434d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3044abd6e1d84ef8bb2c1c6589911c32'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.576342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:11.576342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:11.576342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:11.576342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] PATH_INFO: `/v3/projects/747e2dddd44c407986b96a21836999aa` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:11.576717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 917/1810] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:11 2022] DELETE /identity/v3/users/3044abd6e1d84ef8bb2c1c6589911c32 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:11.576804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] RBAC: Authorizing `identity:delete_project(project_id=747e2dddd44c407986b96a21836999aa)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:11.576804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:11.580014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59fb7f-a0a3-4d78-8d59-0e6aab24959d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:11.580208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59fb7f-a0a3-4d78-8d59-0e6aab24959d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:11.580511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59fb7f-a0a3-4d78-8d59-0e6aab24959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:11.605875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6d59fb7f-a0a3-4d78-8d59-0e6aab24959d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:11.608947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6d59fb7f-a0a3-4d78-8d59-0e6aab24959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:11.683015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 918/1811] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:11.694651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59fb7f-a0a3-4d78-8d59-0e6aab24959d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:11.696152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6d59fb7f-a0a3-4d78-8d59-0e6aab24959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:11.722035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747e2dddd44c407986b96a21836999aa', 'request_id': 'req-ed9c6c9b-3fbb-475f-a962-e065c21b305a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.777931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59fb7f-a0a3-4d78-8d59-0e6aab24959d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:11.807495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747e2dddd44c407986b96a21836999aa', 'request_id': 'req-ed9c6c9b-3fbb-475f-a962-e065c21b305a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.808993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:11.815119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747e2dddd44c407986b96a21836999aa', 'request_id': 'req-ed9c6c9b-3fbb-475f-a962-e065c21b305a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.826521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] The token cache is being invalidate because project 747e2dddd44c407986b96a21836999aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:11.826817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.827514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ed9c6c9b-3fbb-475f-a962-e065c21b305a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:11.829283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 894/1812] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:11 2022] DELETE /identity/v3/projects/747e2dddd44c407986b96a21836999aa => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:11.829454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:11.830190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:11.830595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:11.830875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:11.832834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:11.833867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ab0bf-0ed7-4004-a0ec-cd7957e12aa4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:11.834157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ab0bf-0ed7-4004-a0ec-cd7957e12aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:11.834609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ab0bf-0ed7-4004-a0ec-cd7957e12aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:11.854408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-296ab0bf-0ed7-4004-a0ec-cd7957e12aa4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:11.855621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-296ab0bf-0ed7-4004-a0ec-cd7957e12aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:11.905018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:11.906463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:11.917444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 919/1813] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:11.919365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 895/1814] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:11.927087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183f6b-415a-4339-8ef3-98325f58d125 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:11.927380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183f6b-415a-4339-8ef3-98325f58d125 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:11.927661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183f6b-415a-4339-8ef3-98325f58d125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:11.948086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-77183f6b-415a-4339-8ef3-98325f58d125 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:11.949335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-77183f6b-415a-4339-8ef3-98325f58d125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:11.957634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 896/1815] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:11.963126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:11.972396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4ecd1-f6dc-48fb-aa7f-66bb110d8ba6 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:11.978747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:11.979365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:11.979648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:11.979919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:11.980605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:11.980912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:11.982532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:11.996321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 920/1816] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:12.002690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77183f6b-415a-4339-8ef3-98325f58d125 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:12.013054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77183f6b-415a-4339-8ef3-98325f58d125 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:12.020137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23404bc-1da9-40cc-9c2b-c8ec95db1f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:12.020137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23404bc-1da9-40cc-9c2b-c8ec95db1f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.020137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23404bc-1da9-40cc-9c2b-c8ec95db1f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.020137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23404bc-1da9-40cc-9c2b-c8ec95db1f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.020472 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23404bc-1da9-40cc-9c2b-c8ec95db1f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:12.021946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23404bc-1da9-40cc-9c2b-c8ec95db1f2f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:12.116599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 897/1817] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:12 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:12.120214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:12.132787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8342fa-fcd9-49e3-8695-73afa8dc3521 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:12.216281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225aa0c-1fe2-46ed-a652-fb0817119259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:12.216937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225aa0c-1fe2-46ed-a652-fb0817119259 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.217267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225aa0c-1fe2-46ed-a652-fb0817119259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.217919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225aa0c-1fe2-46ed-a652-fb0817119259 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.218422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225aa0c-1fe2-46ed-a652-fb0817119259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:12.220791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225aa0c-1fe2-46ed-a652-fb0817119259 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:12.233149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:12.336421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 921/1818] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:12 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:10:12.342198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23404bc-1da9-40cc-9c2b-c8ec95db1f2f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:12.359601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23404bc-1da9-40cc-9c2b-c8ec95db1f2f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:12.364931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:12.365845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.366290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.366655 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.367593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:12.372928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:12.390318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 898/1819] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:10:12.394400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225aa0c-1fe2-46ed-a652-fb0817119259 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:12.406030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225aa0c-1fe2-46ed-a652-fb0817119259 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:12.414896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e92c1-d9f5-454f-9414-d7a47aa94382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:12.414896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e92c1-d9f5-454f-9414-d7a47aa94382 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.414896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e92c1-d9f5-454f-9414-d7a47aa94382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.414896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e92c1-d9f5-454f-9414-d7a47aa94382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.415309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e92c1-d9f5-454f-9414-d7a47aa94382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:12.417957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e92c1-d9f5-454f-9414-d7a47aa94382 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:12.435593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:12.440689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:12.456517 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 922/1820] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:12.463699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7d082-d2b3-4a40-9b80-9cbc9a543cf7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:12.468682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:12.469402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.469797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.470089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] PATH_INFO: `/v3/projects/761b3787292e49059e186dd70b56449c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.471508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=761b3787292e49059e186dd70b56449c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:12.473133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e92c1-d9f5-454f-9414-d7a47aa94382 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:12.477027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:12.484577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e92c1-d9f5-454f-9414-d7a47aa94382 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:12.491575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae9b2-c987-4f7a-b6c8-580cd2a23b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:12.492527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae9b2-c987-4f7a-b6c8-580cd2a23b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.493149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae9b2-c987-4f7a-b6c8-580cd2a23b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.493747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae9b2-c987-4f7a-b6c8-580cd2a23b50 admin admin] PATH_INFO: `/v3/projects/e9a3debebeb848fa8c2409d96a4c4588/users/6c965da1efbe42d9bc3466b60d27182a/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.516800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aae9b2-c987-4f7a-b6c8-580cd2a23b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a3debebeb848fa8c2409d96a4c4588, user_id=6c965da1efbe42d9bc3466b60d27182a, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:12.522935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aae9b2-c987-4f7a-b6c8-580cd2a23b50 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:12.622153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 923/1821] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:12 2022] PUT /identity/v3/projects/e9a3debebeb848fa8c2409d96a4c4588/users/6c965da1efbe42d9bc3466b60d27182a/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:12.638621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56e9e-9ae6-4bfc-9066-65209066dd35 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.638914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56e9e-9ae6-4bfc-9066-65209066dd35 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.639195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56e9e-9ae6-4bfc-9066-65209066dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.656825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761b3787292e49059e186dd70b56449c', 'request_id': 'req-20bd8a5e-24b5-45f3-a674-f586e9f8d469'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:12.680350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-61b56e9e-9ae6-4bfc-9066-65209066dd35 None None] MFA Rules not processed for user `6c965da1efbe42d9bc3466b60d27182a`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:12.681581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-61b56e9e-9ae6-4bfc-9066-65209066dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:12.745383 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 924/1822] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:12.754997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761b3787292e49059e186dd70b56449c', 'request_id': 'req-20bd8a5e-24b5-45f3-a674-f586e9f8d469'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:12.762362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b56e9e-9ae6-4bfc-9066-65209066dd35 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:12.764650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761b3787292e49059e186dd70b56449c', 'request_id': 'req-20bd8a5e-24b5-45f3-a674-f586e9f8d469'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:12.765184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-61b56e9e-9ae6-4bfc-9066-65209066dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:12.779581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] The token cache is being invalidate because project 761b3787292e49059e186dd70b56449c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:12.780219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:12.783129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:12.784927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 899/1823] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:12 2022] DELETE /identity/v3/projects/761b3787292e49059e186dd70b56449c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:12.788966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:12.790605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:12.869155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b56e9e-9ae6-4bfc-9066-65209066dd35 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:12.873321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa1d30decad84c7081c7e150812b2964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:12.874189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.874657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.875112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.877258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:12.883263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8a5e-24b5-45f3-a674-f586e9f8d469 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:12.888013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:12.888680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:12.889168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:12.889445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] PATH_INFO: `/v3/users/16c8ca80fec840559dcd06fc159abd80` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:12.890554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:12.890808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c8ca80fec840559dcd06fc159abd80)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:12.892457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:12.892612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:12.903070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 925/1824] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:10:13.114848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c8ca80fec840559dcd06fc159abd80'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.123727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c8ca80fec840559dcd06fc159abd80'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.139404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c8ca80fec840559dcd06fc159abd80'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.174569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:13.202983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c8ca80fec840559dcd06fc159abd80'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.203902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8b56d734-9703-4c48-8b14-c5327026c867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c8ca80fec840559dcd06fc159abd80'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.211575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 900/1825] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:12 2022] DELETE /identity/v3/users/16c8ca80fec840559dcd06fc159abd80 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:13.237441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:13.238919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:13.253197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006e598-003d-4e6c-b46b-1fa597de8403 service glance] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:13.312989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:13.313641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:13.313925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:13.314203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] PATH_INFO: `/v3/users/54c45cdfd1254ee1bf83f52ef781c8b0` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:13.315357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c45cdfd1254ee1bf83f52ef781c8b0)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:13.317332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:13.567760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c45cdfd1254ee1bf83f52ef781c8b0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.594281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c45cdfd1254ee1bf83f52ef781c8b0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.610998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c45cdfd1254ee1bf83f52ef781c8b0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.721915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c45cdfd1254ee1bf83f52ef781c8b0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.722566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c45cdfd1254ee1bf83f52ef781c8b0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:13.730298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 926/1826] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:13 2022] DELETE /identity/v3/users/54c45cdfd1254ee1bf83f52ef781c8b0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:13.745101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b698a-3ba2-4326-812b-392eba43bce2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:13.745101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b698a-3ba2-4326-812b-392eba43bce2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:13.745101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b698a-3ba2-4326-812b-392eba43bce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:13.767723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-467b698a-3ba2-4326-812b-392eba43bce2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:13.769106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-467b698a-3ba2-4326-812b-392eba43bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:13.794097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:13.807050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:13.925124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 901/1827] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:13.935457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b698a-3ba2-4326-812b-392eba43bce2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:13.936916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-467b698a-3ba2-4326-812b-392eba43bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:13.963951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175aac1-101a-4035-bdc2-e9926b141ed1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:13.982895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:13.984210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:13.984532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:13.984806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] PATH_INFO: `/v3/projects/a59f9ca864fd457291f17ace57a20dc0` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:13.990215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59f9ca864fd457291f17ace57a20dc0)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:13.994041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:14.013178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:14.035706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b698a-3ba2-4326-812b-392eba43bce2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:14.039884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e2181-24aa-41d9-9378-16fe106150ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:14.040809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2181-24aa-41d9-9378-16fe106150ed service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:14.041091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2181-24aa-41d9-9378-16fe106150ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:14.041363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2181-24aa-41d9-9378-16fe106150ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:14.058724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e2181-24aa-41d9-9378-16fe106150ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:14.060512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e2181-24aa-41d9-9378-16fe106150ed service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:14.094293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 902/1828] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:14.156094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59f9ca864fd457291f17ace57a20dc0', 'request_id': 'req-6b2d9a74-4dae-4369-ba36-fa690b740181'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:14.170410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59f9ca864fd457291f17ace57a20dc0', 'request_id': 'req-6b2d9a74-4dae-4369-ba36-fa690b740181'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:14.179366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59f9ca864fd457291f17ace57a20dc0', 'request_id': 'req-6b2d9a74-4dae-4369-ba36-fa690b740181'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:14.278749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] The token cache is being invalidate because project a59f9ca864fd457291f17ace57a20dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:14.279123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:14.279783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b2d9a74-4dae-4369-ba36-fa690b740181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:14.284838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 927/1829] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:13 2022] DELETE /identity/v3/projects/a59f9ca864fd457291f17ace57a20dc0 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:14.293768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbde4-715b-482d-94d3-fe8b0899026a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:14.294329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbde4-715b-482d-94d3-fe8b0899026a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:14.294329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbde4-715b-482d-94d3-fe8b0899026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:14.334802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3fbbbde4-715b-482d-94d3-fe8b0899026a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:14.336225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3fbbbde4-715b-482d-94d3-fe8b0899026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:14.445494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae14b3a-9e0a-4938-8f3a-150b0f29b3fa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:14.445815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae14b3a-9e0a-4938-8f3a-150b0f29b3fa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:14.446010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 903/1830] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:14.446123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae14b3a-9e0a-4938-8f3a-150b0f29b3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:14.454763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbde4-715b-482d-94d3-fe8b0899026a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:14.459139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3fbbbde4-715b-482d-94d3-fe8b0899026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:14.484967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8ae14b3a-9e0a-4938-8f3a-150b0f29b3fa None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:14.487490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8ae14b3a-9e0a-4938-8f3a-150b0f29b3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:14.516567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 928/1831] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:14.518615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae14b3a-9e0a-4938-8f3a-150b0f29b3fa None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:14.528907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae14b3a-9e0a-4938-8f3a-150b0f29b3fa None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:14.534058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:14.534746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:14.535037 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:14.535318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:14.536414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:14.555957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:14.561321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:14.614211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 929/1832] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:14.620599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:14.659475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270b45-ee65-4e34-95a0-e70f07da5e89 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:14.665809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbde4-715b-482d-94d3-fe8b0899026a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:14.672465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66234b1d-f7d6-48ae-a933-1c3ce6b9ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:14.673288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66234b1d-f7d6-48ae-a933-1c3ce6b9ec3a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:14.674330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66234b1d-f7d6-48ae-a933-1c3ce6b9ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:14.675178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66234b1d-f7d6-48ae-a933-1c3ce6b9ec3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:14.676825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66234b1d-f7d6-48ae-a933-1c3ce6b9ec3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:14.678945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:14.681081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:14.682458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66234b1d-f7d6-48ae-a933-1c3ce6b9ec3a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:14.682908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:14.684828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:14.689056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:14.804559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 930/1833] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:14 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:14.808120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2314e-88d3-427e-8530-f4642c16205e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:14.812173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2314e-88d3-427e-8530-f4642c16205e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:14.814204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2314e-88d3-427e-8530-f4642c16205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:14.833668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:14.841062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:14.871630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 904/1834] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:14.872634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:14.891999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab708a-00bb-425d-8c59-346e46a2b9cc service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:14.896105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-12a2314e-88d3-427e-8530-f4642c16205e None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:14.897887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-12a2314e-88d3-427e-8530-f4642c16205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:15.040377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e63609-6bfc-4306-83a9-a2c70afad1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:15.040377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63609-6bfc-4306-83a9-a2c70afad1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:15.040377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63609-6bfc-4306-83a9-a2c70afad1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:15.040377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63609-6bfc-4306-83a9-a2c70afad1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:15.040995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e63609-6bfc-4306-83a9-a2c70afad1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:15.040995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e63609-6bfc-4306-83a9-a2c70afad1e3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:15.052222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 931/1835] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:10:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:15.062003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2314e-88d3-427e-8530-f4642c16205e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:15.063869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-12a2314e-88d3-427e-8530-f4642c16205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:15.177875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2314e-88d3-427e-8530-f4642c16205e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:15.183988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee3429-127a-4ba7-a419-ed994a555a79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:15.185147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee3429-127a-4ba7-a419-ed994a555a79 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:15.185896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee3429-127a-4ba7-a419-ed994a555a79 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:15.186457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee3429-127a-4ba7-a419-ed994a555a79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:15.199493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee3429-127a-4ba7-a419-ed994a555a79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:15.202542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee3429-127a-4ba7-a419-ed994a555a79 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:15.216526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 932/1836] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:10:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:10:15.361694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 905/1837] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:14 2022] POST /identity/v3/users => generated 282 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:15.366493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee3429-127a-4ba7-a419-ed994a555a79 service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:15.381878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee3429-127a-4ba7-a419-ed994a555a79 service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:15.397251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5625e-eb4b-44ef-ad10-d409213c9afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:15.397912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5625e-eb4b-44ef-ad10-d409213c9afc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:15.398206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5625e-eb4b-44ef-ad10-d409213c9afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:15.398532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5625e-eb4b-44ef-ad10-d409213c9afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:15.399196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5625e-eb4b-44ef-ad10-d409213c9afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:15.400969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5625e-eb4b-44ef-ad10-d409213c9afc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:15.425503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 933/1838] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:15.426455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e63609-6bfc-4306-83a9-a2c70afad1e3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:15.459488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e63609-6bfc-4306-83a9-a2c70afad1e3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:15.471780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:15.473651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:15.474361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:15.474899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:15.476395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:15.481056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:15.502190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5625e-eb4b-44ef-ad10-d409213c9afc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:15.512542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 906/1839] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:15.546210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5625e-eb4b-44ef-ad10-d409213c9afc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:15.562694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf539f22-d889-43b2-b1ab-c67f0b95b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:15.565756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539f22-d889-43b2-b1ab-c67f0b95b061 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:15.569347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539f22-d889-43b2-b1ab-c67f0b95b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:15.570558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539f22-d889-43b2-b1ab-c67f0b95b061 admin admin] PATH_INFO: `/v3/projects/d315b40773e44591bb01f126c245ba5e/users/5c5104b776ca4c9882cb59e829c34acc/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:15.622425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf539f22-d889-43b2-b1ab-c67f0b95b061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d315b40773e44591bb01f126c245ba5e, user_id=5c5104b776ca4c9882cb59e829c34acc, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:15.629116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf539f22-d889-43b2-b1ab-c67f0b95b061 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:15.661421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:15.752407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 934/1840] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:15 2022] PUT /identity/v3/projects/d315b40773e44591bb01f126c245ba5e/users/5c5104b776ca4c9882cb59e829c34acc/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:15.764610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:15.768679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:15.777370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb292-4724-4aae-a3e5-84a8a81ab20d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:15.778536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb292-4724-4aae-a3e5-84a8a81ab20d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:15.778988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb292-4724-4aae-a3e5-84a8a81ab20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:15.797405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798fe1e-4df0-40f6-ba36-67b3fb07e946 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:15.849708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b65fb292-4724-4aae-a3e5-84a8a81ab20d None None] MFA Rules not processed for user `5c5104b776ca4c9882cb59e829c34acc`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:15.851275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b65fb292-4724-4aae-a3e5-84a8a81ab20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:15.860576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:15.926002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:15.926677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:15.926964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:15.927472 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] PATH_INFO: `/v3/projects/303f2f0c7d874762976ed31381e28745` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:15.932834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=303f2f0c7d874762976ed31381e28745)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:15.952197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:16.037035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 935/1841] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:16.040883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb292-4724-4aae-a3e5-84a8a81ab20d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:16.056962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb292-4724-4aae-a3e5-84a8a81ab20d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:16.070838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a48f5-ff42-401d-b26b-eb3a732f2110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:16.070838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a48f5-ff42-401d-b26b-eb3a732f2110 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:16.070838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a48f5-ff42-401d-b26b-eb3a732f2110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:16.070838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a48f5-ff42-401d-b26b-eb3a732f2110 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:16.071211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a48f5-ff42-401d-b26b-eb3a732f2110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:16.071211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a48f5-ff42-401d-b26b-eb3a732f2110 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:16.139035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '303f2f0c7d874762976ed31381e28745', 'request_id': 'req-0c140dca-b39d-4c7c-b2eb-832113ec80bf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.209307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '303f2f0c7d874762976ed31381e28745', 'request_id': 'req-0c140dca-b39d-4c7c-b2eb-832113ec80bf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.218470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 936/1842] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:16 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:10:16.222443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a48f5-ff42-401d-b26b-eb3a732f2110 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:16.224310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '303f2f0c7d874762976ed31381e28745', 'request_id': 'req-0c140dca-b39d-4c7c-b2eb-832113ec80bf'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.250618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] The token cache is being invalidate because project 303f2f0c7d874762976ed31381e28745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:16.250618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.251391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.258843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 907/1843] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:15 2022] DELETE /identity/v3/projects/303f2f0c7d874762976ed31381e28745 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:16.267253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:16.269266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:16.310045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a48f5-ff42-401d-b26b-eb3a732f2110 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:16.315609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:16.316438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:16.316896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:16.317388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:16.318168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:16.321179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:16.337536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c140dca-b39d-4c7c-b2eb-832113ec80bf admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:16.342679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:16.343443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:16.343888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:16.344172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] PATH_INFO: `/v3/users/903502471da74753960cd5134e62c88f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:16.345544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=903502471da74753960cd5134e62c88f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:16.347485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:16.415236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 937/1844] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:16 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:16.416943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:16.418783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:16.434002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa257fb-9d80-4911-8ec8-104093866ed1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:16.438729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c68c7f-a943-4e50-a06c-21787ae44d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:16.440089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68c7f-a943-4e50-a06c-21787ae44d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:16.440089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68c7f-a943-4e50-a06c-21787ae44d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:16.440089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68c7f-a943-4e50-a06c-21787ae44d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:16.440715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c68c7f-a943-4e50-a06c-21787ae44d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:16.442338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c68c7f-a943-4e50-a06c-21787ae44d28 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:16.457396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 938/1845] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:16.458917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c68c7f-a943-4e50-a06c-21787ae44d28 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:16.470603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c68c7f-a943-4e50-a06c-21787ae44d28 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:16.482719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b109c1-3fab-485e-940c-01f34eaacc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:16.483436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b109c1-3fab-485e-940c-01f34eaacc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:16.483754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b109c1-3fab-485e-940c-01f34eaacc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:16.484029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b109c1-3fab-485e-940c-01f34eaacc72 admin admin] PATH_INFO: `/v3/projects/ac5d42becce74cdb97e857dc2b918088/users/abde492b47074fb3b447837be154c2ee/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:16.517178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b109c1-3fab-485e-940c-01f34eaacc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5d42becce74cdb97e857dc2b918088, user_id=abde492b47074fb3b447837be154c2ee, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:16.521085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b109c1-3fab-485e-940c-01f34eaacc72 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:16.608760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903502471da74753960cd5134e62c88f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.616964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903502471da74753960cd5134e62c88f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.635366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903502471da74753960cd5134e62c88f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.636580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 939/1846] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:16 2022] PUT /identity/v3/projects/ac5d42becce74cdb97e857dc2b918088/users/abde492b47074fb3b447837be154c2ee/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:16.637521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b109c1-3fab-485e-940c-01f34eaacc72 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:16.703738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b109c1-3fab-485e-940c-01f34eaacc72 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:16.708452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:16.709072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:16.709357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:16.709899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:16.710657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:16.712261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:16.722519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 940/1847] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:16.726357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903502471da74753960cd5134e62c88f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.726357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd4321a8-03cf-4afe-b7ff-59ae2dfa35ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903502471da74753960cd5134e62c88f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:16.728191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:16.730131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:16.734922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 908/1848] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:16 2022] DELETE /identity/v3/users/903502471da74753960cd5134e62c88f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:16.745532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f83e77-73f9-4aa2-b2e5-53cf778525b8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:16.825903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:16.826593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:16.826880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:16.827188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] PATH_INFO: `/v3/projects/ac5d42becce74cdb97e857dc2b918088/users/abde492b47074fb3b447837be154c2ee/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:16.829405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5d42becce74cdb97e857dc2b918088, user_id=abde492b47074fb3b447837be154c2ee, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:16.832409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:16.846346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 941/1849] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:16 2022] PUT /identity/v3/projects/ac5d42becce74cdb97e857dc2b918088/users/abde492b47074fb3b447837be154c2ee/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:16.858440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd60d7-e27a-4ad0-9445-6cf9d3274742 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:16.859029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd60d7-e27a-4ad0-9445-6cf9d3274742 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:16.859424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd60d7-e27a-4ad0-9445-6cf9d3274742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:16.889970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7bfd60d7-e27a-4ad0-9445-6cf9d3274742 None None] MFA Rules not processed for user `abde492b47074fb3b447837be154c2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:16.891257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7bfd60d7-e27a-4ad0-9445-6cf9d3274742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:16.970239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 909/1850] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:16.986847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:16.990324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:17.061272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf0b9-bbb9-4a63-a803-e641574faf22 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:17.064904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:17.065515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:17.065796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:17.066069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:17.080554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:17.082083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:17.093446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 942/1851] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:17.343374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd60d7-e27a-4ad0-9445-6cf9d3274742 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:17.367214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:17.369249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:17.379424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:17.380599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd60d7-e27a-4ad0-9445-6cf9d3274742 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:17.387876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b92baf-573c-4698-8efc-2767d321be3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:17.390020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92baf-573c-4698-8efc-2767d321be3a service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:17.391324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92baf-573c-4698-8efc-2767d321be3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:17.391608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92baf-573c-4698-8efc-2767d321be3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:17.393695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-90b92baf-573c-4698-8efc-2767d321be3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:17.450893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5789b-5392-49fb-94e4-68726b728582 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:17.454778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92baf-573c-4698-8efc-2767d321be3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:17.455667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:17.456248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92baf-573c-4698-8efc-2767d321be3a service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:17.456356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:17.456593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:17.456971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] PATH_INFO: `/v3/projects/9ce1ac0adbbd4624bb3694846cfe9e75` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:17.458102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce1ac0adbbd4624bb3694846cfe9e75)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:17.460123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:17.466737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 910/1852] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:17.609119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce1ac0adbbd4624bb3694846cfe9e75', 'request_id': 'req-3d2e554a-6c08-496a-a850-24c90099b4e1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:17.614696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce1ac0adbbd4624bb3694846cfe9e75', 'request_id': 'req-3d2e554a-6c08-496a-a850-24c90099b4e1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:17.620825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce1ac0adbbd4624bb3694846cfe9e75', 'request_id': 'req-3d2e554a-6c08-496a-a850-24c90099b4e1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:17.723338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] The token cache is being invalidate because project 9ce1ac0adbbd4624bb3694846cfe9e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:17.724011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:17.724665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3d2e554a-6c08-496a-a850-24c90099b4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:17.726413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 943/1853] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:17 2022] DELETE /identity/v3/projects/9ce1ac0adbbd4624bb3694846cfe9e75 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:17.731330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368880-6e30-4099-8f09-3117f9cb67e9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:17.731825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368880-6e30-4099-8f09-3117f9cb67e9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:17.731950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368880-6e30-4099-8f09-3117f9cb67e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:17.742324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:17.753113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-74368880-6e30-4099-8f09-3117f9cb67e9 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:17.754313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-74368880-6e30-4099-8f09-3117f9cb67e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:17.816102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 911/1854] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:17.824651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ea02-65ce-43ad-ad2d-d92ca99d101f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:17.824935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ea02-65ce-43ad-ad2d-d92ca99d101f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:17.825210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ea02-65ce-43ad-ad2d-d92ca99d101f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:17.845158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e7b0ea02-65ce-43ad-ad2d-d92ca99d101f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:17.846353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e7b0ea02-65ce-43ad-ad2d-d92ca99d101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:17.854395 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 944/1855] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:17.859024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74368880-6e30-4099-8f09-3117f9cb67e9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:17.869415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74368880-6e30-4099-8f09-3117f9cb67e9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:17.873946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:17.874598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:17.874874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:17.875152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:17.875795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:17.876102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:17.877730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:17.889816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 912/1856] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:17.898423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ea02-65ce-43ad-ad2d-d92ca99d101f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:17.907745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ea02-65ce-43ad-ad2d-d92ca99d101f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:17.932852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250836d6-b4a8-43ec-bc18-37cf4f7d0c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:17.933497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250836d6-b4a8-43ec-bc18-37cf4f7d0c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:17.933782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250836d6-b4a8-43ec-bc18-37cf4f7d0c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:17.934054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250836d6-b4a8-43ec-bc18-37cf4f7d0c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:17.934703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250836d6-b4a8-43ec-bc18-37cf4f7d0c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:17.936657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250836d6-b4a8-43ec-bc18-37cf4f7d0c52 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:18.046103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 945/1857] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:17 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:18.051516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:18.062974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369846-1059-4fc6-a8db-89e01c155048 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:18.126145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4e677-f454-479f-bab2-c6efd9fea72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:18.126688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e677-f454-479f-bab2-c6efd9fea72d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.126975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e677-f454-479f-bab2-c6efd9fea72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.127255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e677-f454-479f-bab2-c6efd9fea72d admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.127893 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4e677-f454-479f-bab2-c6efd9fea72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:18.129897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4e677-f454-479f-bab2-c6efd9fea72d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:18.215520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 913/1858] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:18 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:18.219899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250836d6-b4a8-43ec-bc18-37cf4f7d0c52 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:18.230844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250836d6-b4a8-43ec-bc18-37cf4f7d0c52 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:18.232978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:18.235629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe0644-8cc5-4096-8383-b0e258c4c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:18.236238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0644-8cc5-4096-8383-b0e258c4c743 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.236557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0644-8cc5-4096-8383-b0e258c4c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.236833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0644-8cc5-4096-8383-b0e258c4c743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.237475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe0644-8cc5-4096-8383-b0e258c4c743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:18.239073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe0644-8cc5-4096-8383-b0e258c4c743 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:18.252780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 946/1859] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:18.254345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4e677-f454-479f-bab2-c6efd9fea72d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:18.266566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4e677-f454-479f-bab2-c6efd9fea72d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:18.272602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d01eb-fae9-4a7d-bcee-b310742d753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:18.272602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d01eb-fae9-4a7d-bcee-b310742d753f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.272794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d01eb-fae9-4a7d-bcee-b310742d753f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.273021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d01eb-fae9-4a7d-bcee-b310742d753f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.273951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d01eb-fae9-4a7d-bcee-b310742d753f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:18.276451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d01eb-fae9-4a7d-bcee-b310742d753f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:18.290197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 914/1860] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:18.294410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe0644-8cc5-4096-8383-b0e258c4c743 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:18.305399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe0644-8cc5-4096-8383-b0e258c4c743 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:18.309979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c2ef3-39ff-449b-a927-5cc06e90ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:18.310630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2ef3-39ff-449b-a927-5cc06e90ee49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.310915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2ef3-39ff-449b-a927-5cc06e90ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.311193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c2ef3-39ff-449b-a927-5cc06e90ee49 admin admin] PATH_INFO: `/v3/projects/efc1d3e5588f42bb9ecf74adf23b5514/users/dccd7f8517734ffb9c2c83de009889f9/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.325646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c2ef3-39ff-449b-a927-5cc06e90ee49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc1d3e5588f42bb9ecf74adf23b5514, user_id=dccd7f8517734ffb9c2c83de009889f9, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:18.328314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c2ef3-39ff-449b-a927-5cc06e90ee49 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:18.409957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 947/1861] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:18 2022] PUT /identity/v3/projects/efc1d3e5588f42bb9ecf74adf23b5514/users/dccd7f8517734ffb9c2c83de009889f9/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:18.420576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660280dc-9c59-4e18-a9ee-d3cd6c256dea None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.420873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660280dc-9c59-4e18-a9ee-d3cd6c256dea None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.421144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660280dc-9c59-4e18-a9ee-d3cd6c256dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.455158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-660280dc-9c59-4e18-a9ee-d3cd6c256dea None None] MFA Rules not processed for user `dccd7f8517734ffb9c2c83de009889f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:18.456392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-660280dc-9c59-4e18-a9ee-d3cd6c256dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:18.521799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 915/1862] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:18.527030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c2ef3-39ff-449b-a927-5cc06e90ee49 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:18.596512 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c2ef3-39ff-449b-a927-5cc06e90ee49 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:18.601488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8809-266d-43cc-962f-b6a3412db98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:18.602102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8809-266d-43cc-962f-b6a3412db98f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.602388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8809-266d-43cc-962f-b6a3412db98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.602666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8809-266d-43cc-962f-b6a3412db98f admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.603297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b8809-266d-43cc-962f-b6a3412db98f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:18.605262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b8809-266d-43cc-962f-b6a3412db98f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:18.706522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 948/1863] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:18 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:18.710643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660280dc-9c59-4e18-a9ee-d3cd6c256dea None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:18.711972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:18.721116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660280dc-9c59-4e18-a9ee-d3cd6c256dea None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:18.778202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc73abd-bac8-4d84-bff3-a1dbb7a1e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:18.778898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73abd-bac8-4d84-bff3-a1dbb7a1e96c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.779076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73abd-bac8-4d84-bff3-a1dbb7a1e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.779423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73abd-bac8-4d84-bff3-a1dbb7a1e96c admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.780324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73abd-bac8-4d84-bff3-a1dbb7a1e96c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:18.782031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73abd-bac8-4d84-bff3-a1dbb7a1e96c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:18.873130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 916/1864] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:18 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:18.877307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8809-266d-43cc-962f-b6a3412db98f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:18.888046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8809-266d-43cc-962f-b6a3412db98f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:18.892706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b772-c92e-495c-9ff7-034d825c9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:18.893299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b772-c92e-495c-9ff7-034d825c9fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.893642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b772-c92e-495c-9ff7-034d825c9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.893832 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b772-c92e-495c-9ff7-034d825c9fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.894467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789b772-c92e-495c-9ff7-034d825c9fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:18.896052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789b772-c92e-495c-9ff7-034d825c9fbb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:18.907356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 949/1865] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:18.911564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc73abd-bac8-4d84-bff3-a1dbb7a1e96c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:18.922049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc73abd-bac8-4d84-bff3-a1dbb7a1e96c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:18.926705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a201f-b01c-426a-8f5b-63279f587431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:18.927367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a201f-b01c-426a-8f5b-63279f587431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:18.927652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a201f-b01c-426a-8f5b-63279f587431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:18.927930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a201f-b01c-426a-8f5b-63279f587431 admin admin] PATH_INFO: `/v3/projects/839adc7f42664d7a9c2f4f7ac3a75146/users/b1b67e98f9824d998828ade8d9d68256/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:18.943051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a201f-b01c-426a-8f5b-63279f587431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839adc7f42664d7a9c2f4f7ac3a75146, user_id=b1b67e98f9824d998828ade8d9d68256, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:18.945826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a201f-b01c-426a-8f5b-63279f587431 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:19.076573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 917/1866] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:18 2022] PUT /identity/v3/projects/839adc7f42664d7a9c2f4f7ac3a75146/users/b1b67e98f9824d998828ade8d9d68256/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:19.080793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b772-c92e-495c-9ff7-034d825c9fbb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:19.091299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b772-c92e-495c-9ff7-034d825c9fbb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:19.150474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edffab4-b597-41e7-b1bc-cfd2b0b92d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:19.151089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffab4-b597-41e7-b1bc-cfd2b0b92d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:19.151397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffab4-b597-41e7-b1bc-cfd2b0b92d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:19.151669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffab4-b597-41e7-b1bc-cfd2b0b92d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:19.152310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edffab4-b597-41e7-b1bc-cfd2b0b92d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:19.153922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edffab4-b597-41e7-b1bc-cfd2b0b92d5a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:19.163935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 950/1867] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:19.168142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a201f-b01c-426a-8f5b-63279f587431 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:19.176072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:19.180215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a201f-b01c-426a-8f5b-63279f587431 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:19.196107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:19.196870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:19.197147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:19.197420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] PATH_INFO: `/v3/projects/839adc7f42664d7a9c2f4f7ac3a75146/users/b1b67e98f9824d998828ade8d9d68256/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:19.201932 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=839adc7f42664d7a9c2f4f7ac3a75146, user_id=b1b67e98f9824d998828ade8d9d68256, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:19.202246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:19.219025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 918/1868] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:19 2022] PUT /identity/v3/projects/839adc7f42664d7a9c2f4f7ac3a75146/users/b1b67e98f9824d998828ade8d9d68256/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:19.231474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2fc4d-290f-4a76-be82-8525ec3c0448 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:19.231759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2fc4d-290f-4a76-be82-8525ec3c0448 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:19.232038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2fc4d-290f-4a76-be82-8525ec3c0448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:19.261642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-17f2fc4d-290f-4a76-be82-8525ec3c0448 None None] MFA Rules not processed for user `b1b67e98f9824d998828ade8d9d68256`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:19.262851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-17f2fc4d-290f-4a76-be82-8525ec3c0448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:19.286328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:19.366279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 951/1869] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:19.376427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:19.378176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:19.442703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b803bc-fa37-404c-926a-6f1b1ca6aebf admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:19.447054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e8c55-c083-4d06-bf58-27608478f8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:19.447702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8c55-c083-4d06-bf58-27608478f8bd service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:19.447969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8c55-c083-4d06-bf58-27608478f8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:19.448252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8c55-c083-4d06-bf58-27608478f8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:19.465157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e8c55-c083-4d06-bf58-27608478f8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:19.466599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e8c55-c083-4d06-bf58-27608478f8bd service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:19.478148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 919/1870] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:19.524524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:19.563116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:19.644344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2fc4d-290f-4a76-be82-8525ec3c0448 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:19.662065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2fc4d-290f-4a76-be82-8525ec3c0448 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:19.662065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9b605-5116-4901-8de7-69421525ba6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:19.662065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b605-5116-4901-8de7-69421525ba6e service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:19.662065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b605-5116-4901-8de7-69421525ba6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:19.662408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b605-5116-4901-8de7-69421525ba6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:19.698701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:19.749059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9b605-5116-4901-8de7-69421525ba6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:19.751234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9b605-5116-4901-8de7-69421525ba6e service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:19.761665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 952/1871] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:21.198180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e8c55-c083-4d06-bf58-27608478f8bd service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:21.261547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:21.284136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e8c55-c083-4d06-bf58-27608478f8bd service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:21.289658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:21.290488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:21.290771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:21.291125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] PATH_INFO: `/v3/users/dccd7f8517734ffb9c2c83de009889f9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:21.292273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dccd7f8517734ffb9c2c83de009889f9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:21.294228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:21.577215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dccd7f8517734ffb9c2c83de009889f9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:21.583995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dccd7f8517734ffb9c2c83de009889f9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:21.596328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dccd7f8517734ffb9c2c83de009889f9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:21.723362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dccd7f8517734ffb9c2c83de009889f9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:21.723989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dccd7f8517734ffb9c2c83de009889f9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:21.731110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 920/1872] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:21 2022] DELETE /identity/v3/users/dccd7f8517734ffb9c2c83de009889f9 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:21.735602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a9fc-5889-4eb3-ac60-4b769e7f54eb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:21.736104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a9fc-5889-4eb3-ac60-4b769e7f54eb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:21.736193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a9fc-5889-4eb3-ac60-4b769e7f54eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:21.760127 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d111a9fc-5889-4eb3-ac60-4b769e7f54eb None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:21.761408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d111a9fc-5889-4eb3-ac60-4b769e7f54eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:21.796243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:21.821504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 953/1873] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:21.831608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:21.833021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:21.891912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b950e0-0455-436d-95ce-5e503e874768 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:21.895647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:21.896260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:21.896580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:21.897724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:21.907242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:21.908700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:21.918156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 921/1874] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:22.292784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111a9fc-5889-4eb3-ac60-4b769e7f54eb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:22.294301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d111a9fc-5889-4eb3-ac60-4b769e7f54eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:22.307150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111a9fc-5889-4eb3-ac60-4b769e7f54eb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:22.311973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:22.315941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:22.315941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:22.315941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] PATH_INFO: `/v3/users/5c5104b776ca4c9882cb59e829c34acc` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:22.315941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5104b776ca4c9882cb59e829c34acc)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:22.316304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:22.343501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:22.345145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:22.359360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9b8c2-1f71-4a64-85f6-9c5bfb01d77e service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:22.365107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:22.366323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:22.366617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:22.367047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] PATH_INFO: `/v3/projects/efc1d3e5588f42bb9ecf74adf23b5514` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:22.368215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc1d3e5588f42bb9ecf74adf23b5514)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:22.370240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:22.627223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5104b776ca4c9882cb59e829c34acc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.628093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc1d3e5588f42bb9ecf74adf23b5514', 'request_id': 'req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.642943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5104b776ca4c9882cb59e829c34acc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.650339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5104b776ca4c9882cb59e829c34acc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.694771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc1d3e5588f42bb9ecf74adf23b5514', 'request_id': 'req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.701945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc1d3e5588f42bb9ecf74adf23b5514', 'request_id': 'req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.703188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:22.713248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] The token cache is being invalidate because project efc1d3e5588f42bb9ecf74adf23b5514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:22.713537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.714189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.715667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 922/1875] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:22 2022] DELETE /identity/v3/projects/efc1d3e5588f42bb9ecf74adf23b5514 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:22.719380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:22.720684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:22.763079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5104b776ca4c9882cb59e829c34acc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.763818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-25ee50a8-b202-49a7-b134-4cc46073b89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5104b776ca4c9882cb59e829c34acc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:22.770501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 954/1876] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:22 2022] DELETE /identity/v3/users/5c5104b776ca4c9882cb59e829c34acc => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:22.775529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14016-294b-43c2-87ab-e5f9e2ab5395 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:22.775940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14016-294b-43c2-87ab-e5f9e2ab5395 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:22.776369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14016-294b-43c2-87ab-e5f9e2ab5395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:22.791970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d5f0f-d8d2-40c4-b252-8e5fbc0980fc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:22.796806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c1c14016-294b-43c2-87ab-e5f9e2ab5395 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:22.798054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c1c14016-294b-43c2-87ab-e5f9e2ab5395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:22.853949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:22.854510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:22.854792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:22.855065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] PATH_INFO: `/v3/users/b1b67e98f9824d998828ade8d9d68256` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:22.856206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b67e98f9824d998828ade8d9d68256)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:22.858164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:22.863026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 955/1877] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:22.874061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14016-294b-43c2-87ab-e5f9e2ab5395 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:22.875528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c1c14016-294b-43c2-87ab-e5f9e2ab5395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:22.934148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14016-294b-43c2-87ab-e5f9e2ab5395 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:22.936901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:22.937647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:22.937930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:22.938201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:22.947233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:22.949748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:22.951176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:22.962184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 956/1878] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:10:23.091708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b67e98f9824d998828ade8d9d68256'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.098950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b67e98f9824d998828ade8d9d68256'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.115264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b67e98f9824d998828ade8d9d68256'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.201301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b67e98f9824d998828ade8d9d68256'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.202049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b67e98f9824d998828ade8d9d68256'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.208622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 923/1879] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:22 2022] DELETE /identity/v3/users/b1b67e98f9824d998828ade8d9d68256 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:23.426241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:23.427755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:23.451088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7148dd7-08d0-484f-ae8d-7247fcd4c770 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:23.542447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:23.543280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:23.543397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:23.543652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] PATH_INFO: `/v3/projects/d315b40773e44591bb01f126c245ba5e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:23.544882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d315b40773e44591bb01f126c245ba5e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:23.546995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:23.682712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd315b40773e44591bb01f126c245ba5e', 'request_id': 'req-33f0f776-34d8-4791-887d-c0260741bb66'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.689106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd315b40773e44591bb01f126c245ba5e', 'request_id': 'req-33f0f776-34d8-4791-887d-c0260741bb66'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.696919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd315b40773e44591bb01f126c245ba5e', 'request_id': 'req-33f0f776-34d8-4791-887d-c0260741bb66'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.761937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:23.761937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:23.777666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39da0e-299b-441f-9fa7-d0de650657de admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:23.787731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] The token cache is being invalidate because project d315b40773e44591bb01f126c245ba5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:23.788334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.791608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:23.797016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 957/1880] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:23 2022] DELETE /identity/v3/projects/d315b40773e44591bb01f126c245ba5e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:23.798664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:23.800086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:23.801734 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:23.877755 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:23.886813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:23.886813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:23.886813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] PATH_INFO: `/v3/projects/839adc7f42664d7a9c2f4f7ac3a75146` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:23.886813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839adc7f42664d7a9c2f4f7ac3a75146)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:23.886813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:23.907290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0f776-34d8-4791-887d-c0260741bb66 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:23.915456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:23.916100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:23.916377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:23.916895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] PATH_INFO: `/v3/users/abde492b47074fb3b447837be154c2ee` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:23.918083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abde492b47074fb3b447837be154c2ee)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:23.921979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:24.023137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:24.112807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abde492b47074fb3b447837be154c2ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.113793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839adc7f42664d7a9c2f4f7ac3a75146', 'request_id': 'req-f5a4c9a1-b0d3-455d-a31b-878b27370be5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.124850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abde492b47074fb3b447837be154c2ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.132768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abde492b47074fb3b447837be154c2ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.184035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839adc7f42664d7a9c2f4f7ac3a75146', 'request_id': 'req-f5a4c9a1-b0d3-455d-a31b-878b27370be5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.190902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839adc7f42664d7a9c2f4f7ac3a75146', 'request_id': 'req-f5a4c9a1-b0d3-455d-a31b-878b27370be5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.202985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] The token cache is being invalidate because project 839adc7f42664d7a9c2f4f7ac3a75146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:24.202985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.203981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f5a4c9a1-b0d3-455d-a31b-878b27370be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.210132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 924/1881] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:23 2022] DELETE /identity/v3/projects/839adc7f42664d7a9c2f4f7ac3a75146 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:24.211912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b197-9020-4722-aa41-8a3a0095b320 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.212263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b197-9020-4722-aa41-8a3a0095b320 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.212567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b197-9020-4722-aa41-8a3a0095b320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.235139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bef1b197-9020-4722-aa41-8a3a0095b320 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:24.236382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bef1b197-9020-4722-aa41-8a3a0095b320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:24.301262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abde492b47074fb3b447837be154c2ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.301941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32930272-473b-48a6-94d8-68692324db13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abde492b47074fb3b447837be154c2ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:24.316096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 958/1882] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:23 2022] DELETE /identity/v3/users/abde492b47074fb3b447837be154c2ee => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:24.326410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 925/1883] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:24.336741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad783b0c-aeaa-40aa-a481-def03bc76389 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.336741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad783b0c-aeaa-40aa-a481-def03bc76389 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.336741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad783b0c-aeaa-40aa-a481-def03bc76389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.361706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ad783b0c-aeaa-40aa-a481-def03bc76389 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:24.363178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ad783b0c-aeaa-40aa-a481-def03bc76389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:24.444629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 959/1884] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:24.449382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1b197-9020-4722-aa41-8a3a0095b320 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:24.459853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1b197-9020-4722-aa41-8a3a0095b320 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:24.464638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:24.465256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.465540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.465814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.466512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:24.466799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:24.468676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:24.484519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 926/1885] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:24.486627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad783b0c-aeaa-40aa-a481-def03bc76389 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:24.496695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad783b0c-aeaa-40aa-a481-def03bc76389 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:24.502429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c6b22-5e21-4310-aee0-e7cc8d1987f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:24.503189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6b22-5e21-4310-aee0-e7cc8d1987f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.503526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6b22-5e21-4310-aee0-e7cc8d1987f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.503864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6b22-5e21-4310-aee0-e7cc8d1987f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.504724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c6b22-5e21-4310-aee0-e7cc8d1987f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:24.507018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c6b22-5e21-4310-aee0-e7cc8d1987f0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:24.633378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 960/1886] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:24 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:24.634294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:24.645752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375009c-6c28-44f2-8ab9-b71aece14e35 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:24.689350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:24.718731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3c9ff-052b-4086-b248-4f82e9482674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:24.719397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3c9ff-052b-4086-b248-4f82e9482674 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.719682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3c9ff-052b-4086-b248-4f82e9482674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.719961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3c9ff-052b-4086-b248-4f82e9482674 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.720647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3c9ff-052b-4086-b248-4f82e9482674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:24.724218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3c9ff-052b-4086-b248-4f82e9482674 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:24.830405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 927/1887] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:24 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:10:24.831549 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c6b22-5e21-4310-aee0-e7cc8d1987f0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:24.843687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c6b22-5e21-4310-aee0-e7cc8d1987f0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:24.859216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d7ba0-a2d4-4818-8c41-e6817945cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:24.866812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7ba0-a2d4-4818-8c41-e6817945cf30 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.867100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7ba0-a2d4-4818-8c41-e6817945cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.867384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d7ba0-a2d4-4818-8c41-e6817945cf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.868105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d7ba0-a2d4-4818-8c41-e6817945cf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:24.869836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d7ba0-a2d4-4818-8c41-e6817945cf30 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:24.880817 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 961/1888] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:10:24.885002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3c9ff-052b-4086-b248-4f82e9482674 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:24.896944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3c9ff-052b-4086-b248-4f82e9482674 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:24.901605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:24.902215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.902546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.902829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.903471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:24.905097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:24.916350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 928/1889] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:24.920595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d7ba0-a2d4-4818-8c41-e6817945cf30 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:24.931418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d7ba0-a2d4-4818-8c41-e6817945cf30 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:24.940361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05235fd-791a-4d38-8ca4-f4817f6377e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:24.941002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05235fd-791a-4d38-8ca4-f4817f6377e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.941292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05235fd-791a-4d38-8ca4-f4817f6377e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.941568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05235fd-791a-4d38-8ca4-f4817f6377e3 admin admin] PATH_INFO: `/v3/projects/62828c9d22654fd8a70793c11b7eac87/users/147ef96e0e6840d3b1bcebf1ce667242/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.951572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:24.953391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:24.959696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05235fd-791a-4d38-8ca4-f4817f6377e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62828c9d22654fd8a70793c11b7eac87, user_id=147ef96e0e6840d3b1bcebf1ce667242, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:24.962437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05235fd-791a-4d38-8ca4-f4817f6377e3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:24.981750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878280-f911-4913-8f40-aedfc6641f8d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:24.994043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:24.994043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:24.994043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:24.994043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] PATH_INFO: `/v3/projects/ac5d42becce74cdb97e857dc2b918088` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:24.994560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5d42becce74cdb97e857dc2b918088)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:24.994560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:25.045099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 962/1890] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:24 2022] PUT /identity/v3/projects/62828c9d22654fd8a70793c11b7eac87/users/147ef96e0e6840d3b1bcebf1ce667242/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:25.050107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93106-ddd5-4ded-9eec-cf4552f39953 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.050390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93106-ddd5-4ded-9eec-cf4552f39953 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.050665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93106-ddd5-4ded-9eec-cf4552f39953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.070351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d7c93106-ddd5-4ded-9eec-cf4552f39953 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:25.071560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d7c93106-ddd5-4ded-9eec-cf4552f39953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:25.109211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5d42becce74cdb97e857dc2b918088', 'request_id': 'req-9b097a5e-71c3-44b2-a546-27cde828d09e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:25.121919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:25.137764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 963/1891] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:25.148167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93106-ddd5-4ded-9eec-cf4552f39953 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:25.149668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d7c93106-ddd5-4ded-9eec-cf4552f39953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:25.184800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5d42becce74cdb97e857dc2b918088', 'request_id': 'req-9b097a5e-71c3-44b2-a546-27cde828d09e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:25.192630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5d42becce74cdb97e857dc2b918088', 'request_id': 'req-9b097a5e-71c3-44b2-a546-27cde828d09e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:25.211225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] The token cache is being invalidate because project ac5d42becce74cdb97e857dc2b918088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:25.211542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:25.213382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9b097a5e-71c3-44b2-a546-27cde828d09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:25.215991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 929/1892] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:24 2022] DELETE /identity/v3/projects/ac5d42becce74cdb97e857dc2b918088 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:25.221987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb40980-a8d2-4ce8-a413-779ce9bbfc2c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.223329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb40980-a8d2-4ce8-a413-779ce9bbfc2c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.223720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93106-ddd5-4ded-9eec-cf4552f39953 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:25.223853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb40980-a8d2-4ce8-a413-779ce9bbfc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.281513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9bb40980-a8d2-4ce8-a413-779ce9bbfc2c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:25.282741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9bb40980-a8d2-4ce8-a413-779ce9bbfc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:25.284750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:25.285510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.285941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.286276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.289216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:25.348645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 930/1893] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:25.357203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a0ad-db08-4516-902d-782602413475 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.357485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a0ad-db08-4516-902d-782602413475 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.357753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712a0ad-db08-4516-902d-782602413475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.363683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:25.365173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:25.375165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 964/1894] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:10:25.377566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6712a0ad-db08-4516-902d-782602413475 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:25.378796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6712a0ad-db08-4516-902d-782602413475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:25.390199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 931/1895] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:25.394126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:25.406719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58569-7cc8-4a95-aaca-ca8d68f9ccbb service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:25.411827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:25.412605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.413012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.413346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.420153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:25.420663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:25.423130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:25.435909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 965/1896] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:25.440512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a0ad-db08-4516-902d-782602413475 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:25.450857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712a0ad-db08-4516-902d-782602413475 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:25.455551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30048e-a4a3-48ce-afe1-0b92b8c8b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:25.456148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30048e-a4a3-48ce-afe1-0b92b8c8b61c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.456425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30048e-a4a3-48ce-afe1-0b92b8c8b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.456728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30048e-a4a3-48ce-afe1-0b92b8c8b61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.457362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30048e-a4a3-48ce-afe1-0b92b8c8b61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:25.459353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30048e-a4a3-48ce-afe1-0b92b8c8b61c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:25.577738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 932/1897] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:25 2022] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:25.582142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:25.593459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82ef7c-b0f1-4b91-ae62-acad59677d87 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:25.643055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:25.661411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c77a31-9fd4-4b35-b84f-08b4f2f10cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:25.661832 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c77a31-9fd4-4b35-b84f-08b4f2f10cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.662269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c77a31-9fd4-4b35-b84f-08b4f2f10cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.663130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c77a31-9fd4-4b35-b84f-08b4f2f10cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.663259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c77a31-9fd4-4b35-b84f-08b4f2f10cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:25.665234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c77a31-9fd4-4b35-b84f-08b4f2f10cf9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:25.765324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 966/1898] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:25 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:25.769718 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30048e-a4a3-48ce-afe1-0b92b8c8b61c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:25.782812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30048e-a4a3-48ce-afe1-0b92b8c8b61c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:25.788294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafbd7e-1847-423d-a49a-7efc49e9e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:25.788960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafbd7e-1847-423d-a49a-7efc49e9e176 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.789241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafbd7e-1847-423d-a49a-7efc49e9e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.789514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafbd7e-1847-423d-a49a-7efc49e9e176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.790158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafbd7e-1847-423d-a49a-7efc49e9e176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:25.791811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafbd7e-1847-423d-a49a-7efc49e9e176 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:25.793239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:25.802443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 933/1899] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:25.810160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c77a31-9fd4-4b35-b84f-08b4f2f10cf9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:25.820972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c77a31-9fd4-4b35-b84f-08b4f2f10cf9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:25.825665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6fb9f-7494-43a2-9a17-62139ba37f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:25.826276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6fb9f-7494-43a2-9a17-62139ba37f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.826559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6fb9f-7494-43a2-9a17-62139ba37f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.827011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6fb9f-7494-43a2-9a17-62139ba37f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.827534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6fb9f-7494-43a2-9a17-62139ba37f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:25.829176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6fb9f-7494-43a2-9a17-62139ba37f92 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:25.841185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 967/1900] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:25.845435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafbd7e-1847-423d-a49a-7efc49e9e176 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:25.857061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafbd7e-1847-423d-a49a-7efc49e9e176 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:25.861836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7022f-3c7a-420a-b462-45f644b638ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:25.862496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7022f-3c7a-420a-b462-45f644b638ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:25.862773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7022f-3c7a-420a-b462-45f644b638ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:25.863047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7022f-3c7a-420a-b462-45f644b638ce admin admin] PATH_INFO: `/v3/projects/1620c398354341409642cc2c73941f66/users/56e5f36bb1ca436e9a877f2199842349/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:25.888234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7022f-3c7a-420a-b462-45f644b638ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1620c398354341409642cc2c73941f66, user_id=56e5f36bb1ca436e9a877f2199842349, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:25.891245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7022f-3c7a-420a-b462-45f644b638ce admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:26.001435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 934/1901] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:25 2022] PUT /identity/v3/projects/1620c398354341409642cc2c73941f66/users/56e5f36bb1ca436e9a877f2199842349/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:26.013403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef31d0-2fc4-4d13-aaaf-0ab89ddc08c9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.013894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef31d0-2fc4-4d13-aaaf-0ab89ddc08c9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.016160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef31d0-2fc4-4d13-aaaf-0ab89ddc08c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.045185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-23ef31d0-2fc4-4d13-aaaf-0ab89ddc08c9 None None] MFA Rules not processed for user `56e5f36bb1ca436e9a877f2199842349`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:26.049303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-23ef31d0-2fc4-4d13-aaaf-0ab89ddc08c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:26.123855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 968/1902] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:26.128408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7022f-3c7a-420a-b462-45f644b638ce admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:26.194713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7022f-3c7a-420a-b462-45f644b638ce admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:26.199652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575699e7-54bb-4323-984f-060eb42de476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:26.200264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575699e7-54bb-4323-984f-060eb42de476 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.200577 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575699e7-54bb-4323-984f-060eb42de476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.200856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575699e7-54bb-4323-984f-060eb42de476 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.201503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575699e7-54bb-4323-984f-060eb42de476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:26.203437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575699e7-54bb-4323-984f-060eb42de476 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:26.336065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 935/1903] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:26 2022] POST /identity/v3/projects => generated 389 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:26.337705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef31d0-2fc4-4d13-aaaf-0ab89ddc08c9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:26.350541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef31d0-2fc4-4d13-aaaf-0ab89ddc08c9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:26.427138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db243-55cc-42e4-ba96-1fb1e6ef50ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:26.428913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db243-55cc-42e4-ba96-1fb1e6ef50ce admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.429546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db243-55cc-42e4-ba96-1fb1e6ef50ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.430079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db243-55cc-42e4-ba96-1fb1e6ef50ce admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.430983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249db243-55cc-42e4-ba96-1fb1e6ef50ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:26.433278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249db243-55cc-42e4-ba96-1fb1e6ef50ce admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:26.511627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 969/1904] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:26 2022] POST /identity/v3/users => generated 301 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:26.516375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575699e7-54bb-4323-984f-060eb42de476 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:26.529388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575699e7-54bb-4323-984f-060eb42de476 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:26.534048 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246be82-cce9-441d-9940-386985eef186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:26.534671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246be82-cce9-441d-9940-386985eef186 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.534953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246be82-cce9-441d-9940-386985eef186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.535225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246be82-cce9-441d-9940-386985eef186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.535931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246be82-cce9-441d-9940-386985eef186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:26.538286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246be82-cce9-441d-9940-386985eef186 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:26.550280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 936/1905] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:26.554741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db243-55cc-42e4-ba96-1fb1e6ef50ce admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:26.565625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db243-55cc-42e4-ba96-1fb1e6ef50ce admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:26.574503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f160db4-3530-48b4-a322-9191e87384ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:26.574503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160db4-3530-48b4-a322-9191e87384ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.574503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160db4-3530-48b4-a322-9191e87384ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.574503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160db4-3530-48b4-a322-9191e87384ab admin admin] PATH_INFO: `/v3/projects/179acebb99c048ae8275e629f3f04c26/users/e71741449dbd4451b9ffb63e7f25f234/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.589257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f160db4-3530-48b4-a322-9191e87384ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=179acebb99c048ae8275e629f3f04c26, user_id=e71741449dbd4451b9ffb63e7f25f234, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:26.592410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f160db4-3530-48b4-a322-9191e87384ab admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:26.710432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 970/1906] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:26 2022] PUT /identity/v3/projects/179acebb99c048ae8275e629f3f04c26/users/e71741449dbd4451b9ffb63e7f25f234/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:26.714938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246be82-cce9-441d-9940-386985eef186 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:26.727487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246be82-cce9-441d-9940-386985eef186 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:26.812098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cdc61-1502-40de-9f15-2cea9996be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:26.812767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cdc61-1502-40de-9f15-2cea9996be74 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.813132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cdc61-1502-40de-9f15-2cea9996be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.813371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cdc61-1502-40de-9f15-2cea9996be74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.814012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cdc61-1502-40de-9f15-2cea9996be74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:26.815824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cdc61-1502-40de-9f15-2cea9996be74 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:26.816759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080deb2-51dd-491e-869c-74aa271dd964 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.817082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080deb2-51dd-491e-869c-74aa271dd964 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.817358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080deb2-51dd-491e-869c-74aa271dd964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.827121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 937/1907] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:26.831500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cdc61-1502-40de-9f15-2cea9996be74 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:26.842664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cdc61-1502-40de-9f15-2cea9996be74 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:26.847544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc876a-76e1-49fb-a590-bd1c86e9e083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:26.848465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc876a-76e1-49fb-a590-bd1c86e9e083 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.848781 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc876a-76e1-49fb-a590-bd1c86e9e083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.849051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc876a-76e1-49fb-a590-bd1c86e9e083 admin admin] PATH_INFO: `/v3/projects/179acebb99c048ae8275e629f3f04c26/users/e71741449dbd4451b9ffb63e7f25f234/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.851255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc876a-76e1-49fb-a590-bd1c86e9e083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179acebb99c048ae8275e629f3f04c26, user_id=e71741449dbd4451b9ffb63e7f25f234, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:26.854625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc876a-76e1-49fb-a590-bd1c86e9e083 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:26.858686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2080deb2-51dd-491e-869c-74aa271dd964 None None] MFA Rules not processed for user `147ef96e0e6840d3b1bcebf1ce667242`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:26.861051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2080deb2-51dd-491e-869c-74aa271dd964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:26.866876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 938/1908] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:26 2022] PUT /identity/v3/projects/179acebb99c048ae8275e629f3f04c26/users/e71741449dbd4451b9ffb63e7f25f234/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:26.868911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:26.876770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5b20-1929-446f-8adc-df74818a74e3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:26.877497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5b20-1929-446f-8adc-df74818a74e3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:26.877917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad5b20-1929-446f-8adc-df74818a74e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:26.909486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1bad5b20-1929-446f-8adc-df74818a74e3 None None] MFA Rules not processed for user `e71741449dbd4451b9ffb63e7f25f234`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:26.910984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1bad5b20-1929-446f-8adc-df74818a74e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:26.928911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:26.954402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 971/1909] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:26.955300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080deb2-51dd-491e-869c-74aa271dd964 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:26.956885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2080deb2-51dd-491e-869c-74aa271dd964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:26.995726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 939/1910] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:27.008272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad5b20-1929-446f-8adc-df74818a74e3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:27.010836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1bad5b20-1929-446f-8adc-df74818a74e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:27.033402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080deb2-51dd-491e-869c-74aa271dd964 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.039116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376017ab-f365-42af-be88-a460b8fc040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.039821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376017ab-f365-42af-be88-a460b8fc040e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.043243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376017ab-f365-42af-be88-a460b8fc040e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.043243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376017ab-f365-42af-be88-a460b8fc040e admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.043243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376017ab-f365-42af-be88-a460b8fc040e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.043243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376017ab-f365-42af-be88-a460b8fc040e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.082882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad5b20-1929-446f-8adc-df74818a74e3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.087280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26973e87-8dd7-4256-9388-857024757c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.087894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26973e87-8dd7-4256-9388-857024757c3c service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.088173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26973e87-8dd7-4256-9388-857024757c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.088447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26973e87-8dd7-4256-9388-857024757c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.097560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26973e87-8dd7-4256-9388-857024757c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.099241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26973e87-8dd7-4256-9388-857024757c3c service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.109151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 940/1911] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:10:27.122388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 972/1912] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:26 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:27.128764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26973e87-8dd7-4256-9388-857024757c3c service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:27.144312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26973e87-8dd7-4256-9388-857024757c3c service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.248291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8175a4-d712-497b-8ccd-4214a7733ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.249519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8175a4-d712-497b-8ccd-4214a7733ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.249815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8175a4-d712-497b-8ccd-4214a7733ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.250082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8175a4-d712-497b-8ccd-4214a7733ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.250730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8175a4-d712-497b-8ccd-4214a7733ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.252739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8175a4-d712-497b-8ccd-4214a7733ea0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.320509 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376017ab-f365-42af-be88-a460b8fc040e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:27.331159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376017ab-f365-42af-be88-a460b8fc040e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.335749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.336394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.336716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.336996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] PATH_INFO: `/v3/users/56e5f36bb1ca436e9a877f2199842349` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.338152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e5f36bb1ca436e9a877f2199842349)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.340091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.340989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 941/1913] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:27 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:27.346415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8175a4-d712-497b-8ccd-4214a7733ea0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:27.359696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8175a4-d712-497b-8ccd-4214a7733ea0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.373903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a746-5517-4585-a6b0-699aeeabf291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.374605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a746-5517-4585-a6b0-699aeeabf291 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.374886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a746-5517-4585-a6b0-699aeeabf291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.375234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a746-5517-4585-a6b0-699aeeabf291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.375893 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2a746-5517-4585-a6b0-699aeeabf291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.377524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2a746-5517-4585-a6b0-699aeeabf291 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.392226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 942/1914] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:10:27.396464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a746-5517-4585-a6b0-699aeeabf291 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:27.417763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a746-5517-4585-a6b0-699aeeabf291 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.424302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9af10d-3486-4372-a14c-0716c5b2eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.425098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9af10d-3486-4372-a14c-0716c5b2eab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.425386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9af10d-3486-4372-a14c-0716c5b2eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.425667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9af10d-3486-4372-a14c-0716c5b2eab3 admin admin] PATH_INFO: `/v3/projects/34d8993994a64e948853901580be7ac3/users/fdda010b889e4676b7e4b14797668f68/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.452035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9af10d-3486-4372-a14c-0716c5b2eab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d8993994a64e948853901580be7ac3, user_id=fdda010b889e4676b7e4b14797668f68, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.454809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9af10d-3486-4372-a14c-0716c5b2eab3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.532585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e5f36bb1ca436e9a877f2199842349'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:27.538540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 943/1915] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:27 2022] PUT /identity/v3/projects/34d8993994a64e948853901580be7ac3/users/fdda010b889e4676b7e4b14797668f68/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:27.539776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9af10d-3486-4372-a14c-0716c5b2eab3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:27.548313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e5f36bb1ca436e9a877f2199842349'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:27.553551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:27.555638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e5f36bb1ca436e9a877f2199842349'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:27.605151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9af10d-3486-4372-a14c-0716c5b2eab3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.612413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.614662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.614662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.614662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.614662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.616148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.626328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 944/1916] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:10:27.629756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e5f36bb1ca436e9a877f2199842349'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:27.630423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ecba8bfd-6275-4357-b723-5edfcdbc0da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e5f36bb1ca436e9a877f2199842349'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:27.630530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:27.632514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:27.637023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 973/1917] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:27 2022] DELETE /identity/v3/users/56e5f36bb1ca436e9a877f2199842349 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:27.641267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f1d0-ddbd-469c-9cfd-17ecac1e382b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.641626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f1d0-ddbd-469c-9cfd-17ecac1e382b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.641903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f1d0-ddbd-469c-9cfd-17ecac1e382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.645091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea78597-b518-4ff2-9432-24e65fef2553 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.649563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:27.663230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4f95f1d0-ddbd-469c-9cfd-17ecac1e382b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:27.664437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4f95f1d0-ddbd-469c-9cfd-17ecac1e382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:27.706230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.707031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.707317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.707595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] PATH_INFO: `/v3/projects/34d8993994a64e948853901580be7ac3/users/fdda010b889e4676b7e4b14797668f68/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.710810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d8993994a64e948853901580be7ac3, user_id=fdda010b889e4676b7e4b14797668f68, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.713630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.731824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 974/1918] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:27.733463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 945/1919] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:27 2022] PUT /identity/v3/projects/34d8993994a64e948853901580be7ac3/users/fdda010b889e4676b7e4b14797668f68/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:27.739629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95f1d0-ddbd-469c-9cfd-17ecac1e382b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:27.741019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4f95f1d0-ddbd-469c-9cfd-17ecac1e382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:27.826465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95f1d0-ddbd-469c-9cfd-17ecac1e382b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:27.879605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e617dd-e811-4f36-8f4e-6d6eddc0bbca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:27.880293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e617dd-e811-4f36-8f4e-6d6eddc0bbca service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:27.880746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e617dd-e811-4f36-8f4e-6d6eddc0bbca service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:27.881626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e617dd-e811-4f36-8f4e-6d6eddc0bbca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:27.963240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e617dd-e811-4f36-8f4e-6d6eddc0bbca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:27.964893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e617dd-e811-4f36-8f4e-6d6eddc0bbca service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:27.975569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 975/1920] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:28.433442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:28.435692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:28.476173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8539-83ed-4591-bcb3-63e9bf8ed53b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:28.489001 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:28.489683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:28.490025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:28.490188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] PATH_INFO: `/v3/projects/1620c398354341409642cc2c73941f66` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:28.494340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1620c398354341409642cc2c73941f66)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:28.496259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:28.662057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1620c398354341409642cc2c73941f66', 'request_id': 'req-22a76867-d380-4487-8b2d-f2bd7bee617c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:28.732632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1620c398354341409642cc2c73941f66', 'request_id': 'req-22a76867-d380-4487-8b2d-f2bd7bee617c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:28.743331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1620c398354341409642cc2c73941f66', 'request_id': 'req-22a76867-d380-4487-8b2d-f2bd7bee617c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:28.755668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] The token cache is being invalidate because project 1620c398354341409642cc2c73941f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:28.756031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:28.756774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22a76867-d380-4487-8b2d-f2bd7bee617c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:28.761910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 946/1921] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:28 2022] DELETE /identity/v3/projects/1620c398354341409642cc2c73941f66 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:28.762380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e617dd-e811-4f36-8f4e-6d6eddc0bbca service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:28.772537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e617dd-e811-4f36-8f4e-6d6eddc0bbca service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:28.796872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:28.852035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:28.852761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:28.853109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:28.853383 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] PATH_INFO: `/v3/users/e71741449dbd4451b9ffb63e7f25f234` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:28.854685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71741449dbd4451b9ffb63e7f25f234)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:28.856744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:29.047471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71741449dbd4451b9ffb63e7f25f234'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.060378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71741449dbd4451b9ffb63e7f25f234'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.067300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71741449dbd4451b9ffb63e7f25f234'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.169025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71741449dbd4451b9ffb63e7f25f234'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.169712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71741449dbd4451b9ffb63e7f25f234'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.176416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 976/1922] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:28 2022] DELETE /identity/v3/users/e71741449dbd4451b9ffb63e7f25f234 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:29.359931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6fc6a-3a96-4db6-bf23-4f0374e1eec9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:29.359931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6fc6a-3a96-4db6-bf23-4f0374e1eec9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:29.359931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6fc6a-3a96-4db6-bf23-4f0374e1eec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:29.389151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8dc6fc6a-3a96-4db6-bf23-4f0374e1eec9 None None] MFA Rules not processed for user `fdda010b889e4676b7e4b14797668f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:29.393223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8dc6fc6a-3a96-4db6-bf23-4f0374e1eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:29.407164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:29.488658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 947/1923] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:29.497717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:29.499585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:29.565205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34910c4-b5ab-4893-86ab-ea1aa5e18121 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:29.568890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1476e6-1a33-4203-869d-78581796f348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:29.569498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1476e6-1a33-4203-869d-78581796f348 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:29.569774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1476e6-1a33-4203-869d-78581796f348 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:29.570041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1476e6-1a33-4203-869d-78581796f348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:29.574671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ea1476e6-1a33-4203-869d-78581796f348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:29.619259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:29.635615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1476e6-1a33-4203-869d-78581796f348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:29.637219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1476e6-1a33-4203-869d-78581796f348 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:29.637793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6fc6a-3a96-4db6-bf23-4f0374e1eec9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:29.639335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8dc6fc6a-3a96-4db6-bf23-4f0374e1eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:29.647233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 977/1924] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:29.712813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6fc6a-3a96-4db6-bf23-4f0374e1eec9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:29.717920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:29.719091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:29.719091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:29.719285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] PATH_INFO: `/v3/projects/179acebb99c048ae8275e629f3f04c26` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:29.720510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179acebb99c048ae8275e629f3f04c26)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:29.722481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:29.858730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179acebb99c048ae8275e629f3f04c26', 'request_id': 'req-4bdd4834-2749-4da8-9d38-fe74b5710157'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.952227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179acebb99c048ae8275e629f3f04c26', 'request_id': 'req-4bdd4834-2749-4da8-9d38-fe74b5710157'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.980942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179acebb99c048ae8275e629f3f04c26', 'request_id': 'req-4bdd4834-2749-4da8-9d38-fe74b5710157'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.985103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] The token cache is being invalidate because project 179acebb99c048ae8275e629f3f04c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:29.985398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.986071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4bdd4834-2749-4da8-9d38-fe74b5710157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:29.987566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 948/1925] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:29 2022] DELETE /identity/v3/projects/179acebb99c048ae8275e629f3f04c26 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:29.993302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b4a5-99a2-4cc8-a7e6-0a33e1f45577 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:29.993586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b4a5-99a2-4cc8-a7e6-0a33e1f45577 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:29.993872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b4a5-99a2-4cc8-a7e6-0a33e1f45577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.014412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1e96b4a5-99a2-4cc8-a7e6-0a33e1f45577 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:30.015754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1e96b4a5-99a2-4cc8-a7e6-0a33e1f45577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:30.081462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 978/1926] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:30.089507 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56918a-fa64-4e7a-bdcc-088941d9668d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.089825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56918a-fa64-4e7a-bdcc-088941d9668d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.090125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56918a-fa64-4e7a-bdcc-088941d9668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.111495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8d56918a-fa64-4e7a-bdcc-088941d9668d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:30.112766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8d56918a-fa64-4e7a-bdcc-088941d9668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:30.121049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 949/1927] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:10:30.125568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96b4a5-99a2-4cc8-a7e6-0a33e1f45577 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:30.135995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96b4a5-99a2-4cc8-a7e6-0a33e1f45577 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:30.140663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:30.141269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.141546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.141820 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.142470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:30.142777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:30.144412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:30.156357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 979/1928] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:30.160748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56918a-fa64-4e7a-bdcc-088941d9668d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:30.170666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56918a-fa64-4e7a-bdcc-088941d9668d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:30.175282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5093-6acd-4e88-9c12-a7fc85b0cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:30.175890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5093-6acd-4e88-9c12-a7fc85b0cfba admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.176169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5093-6acd-4e88-9c12-a7fc85b0cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.176446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5093-6acd-4e88-9c12-a7fc85b0cfba admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.177156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5093-6acd-4e88-9c12-a7fc85b0cfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:30.179320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5093-6acd-4e88-9c12-a7fc85b0cfba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:30.249706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 950/1929] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:30 2022] POST /identity/v3/projects => generated 407 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:30.253956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:30.264636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eb09c-72c8-4d52-940f-770b18733edd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:30.340173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e949746-792b-4ba2-8456-c9034d091eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:30.340671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e949746-792b-4ba2-8456-c9034d091eab admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.340953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e949746-792b-4ba2-8456-c9034d091eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.341226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e949746-792b-4ba2-8456-c9034d091eab admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.341874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e949746-792b-4ba2-8456-c9034d091eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:30.343774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e949746-792b-4ba2-8456-c9034d091eab admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:30.471368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 980/1930] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:30 2022] POST /identity/v3/users => generated 304 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:30.476669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5093-6acd-4e88-9c12-a7fc85b0cfba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:30.487284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5093-6acd-4e88-9c12-a7fc85b0cfba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:30.497735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181e0f7-3a8d-459f-a500-21bb766fcfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:30.502816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181e0f7-3a8d-459f-a500-21bb766fcfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.502816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181e0f7-3a8d-459f-a500-21bb766fcfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.502816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181e0f7-3a8d-459f-a500-21bb766fcfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.502816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181e0f7-3a8d-459f-a500-21bb766fcfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:30.502816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181e0f7-3a8d-459f-a500-21bb766fcfd3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:30.506889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:30.511823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 951/1931] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:30.515863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e949746-792b-4ba2-8456-c9034d091eab admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:30.526790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e949746-792b-4ba2-8456-c9034d091eab admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:30.531635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5b19d-a580-4487-bdc2-d491025e05b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:30.537716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b19d-a580-4487-bdc2-d491025e05b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.537716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b19d-a580-4487-bdc2-d491025e05b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.537716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b19d-a580-4487-bdc2-d491025e05b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.537716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5b19d-a580-4487-bdc2-d491025e05b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:30.537716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5b19d-a580-4487-bdc2-d491025e05b3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:30.553135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181e0f7-3a8d-459f-a500-21bb766fcfd3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:30.553540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 981/1932] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:30.565113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181e0f7-3a8d-459f-a500-21bb766fcfd3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:30.573792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e987e-24a8-43ad-bf4e-c03718b66c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:30.574462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e987e-24a8-43ad-bf4e-c03718b66c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.574748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e987e-24a8-43ad-bf4e-c03718b66c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.575025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e987e-24a8-43ad-bf4e-c03718b66c97 admin admin] PATH_INFO: `/v3/projects/824c77a2c5dd453cadf0a273ab75f035/users/c6cee4f4ba7541778048c7231898c572/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.595104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e987e-24a8-43ad-bf4e-c03718b66c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824c77a2c5dd453cadf0a273ab75f035, user_id=c6cee4f4ba7541778048c7231898c572, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:30.595104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e987e-24a8-43ad-bf4e-c03718b66c97 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:30.693971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 952/1933] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:30 2022] PUT /identity/v3/projects/824c77a2c5dd453cadf0a273ab75f035/users/c6cee4f4ba7541778048c7231898c572/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:30.705653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683714e-c772-4ab8-b1df-fd37eeec6e81 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.705945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683714e-c772-4ab8-b1df-fd37eeec6e81 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.706259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683714e-c772-4ab8-b1df-fd37eeec6e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.738146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9683714e-c772-4ab8-b1df-fd37eeec6e81 None None] MFA Rules not processed for user `c6cee4f4ba7541778048c7231898c572`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:30.738146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9683714e-c772-4ab8-b1df-fd37eeec6e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:30.786236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:30.813112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 982/1934] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:30.821456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e987e-24a8-43ad-bf4e-c03718b66c97 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:30.880282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e987e-24a8-43ad-bf4e-c03718b66c97 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:30.885430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b797-b528-4872-a83b-5b02f2704e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:30.886050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b797-b528-4872-a83b-5b02f2704e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:30.886332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b797-b528-4872-a83b-5b02f2704e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:30.886610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b797-b528-4872-a83b-5b02f2704e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:30.887296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b797-b528-4872-a83b-5b02f2704e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:30.889245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b797-b528-4872-a83b-5b02f2704e2c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:31.000565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 953/1935] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:30 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:31.002322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683714e-c772-4ab8-b1df-fd37eeec6e81 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:31.016221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683714e-c772-4ab8-b1df-fd37eeec6e81 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:31.098134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38210256-232c-4c8d-8924-827df267a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:31.098836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38210256-232c-4c8d-8924-827df267a20b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:31.099016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38210256-232c-4c8d-8924-827df267a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:31.099285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38210256-232c-4c8d-8924-827df267a20b admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:31.100540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38210256-232c-4c8d-8924-827df267a20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:31.102583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38210256-232c-4c8d-8924-827df267a20b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:31.208993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 983/1936] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:31 2022] POST /identity/v3/users => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:31.213502 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b797-b528-4872-a83b-5b02f2704e2c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:31.224200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b797-b528-4872-a83b-5b02f2704e2c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:31.229842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee5515-9ac2-4cb8-b1cb-2d3ea9b35a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:31.230451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee5515-9ac2-4cb8-b1cb-2d3ea9b35a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:31.230727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee5515-9ac2-4cb8-b1cb-2d3ea9b35a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:31.230998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee5515-9ac2-4cb8-b1cb-2d3ea9b35a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:31.231633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee5515-9ac2-4cb8-b1cb-2d3ea9b35a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:31.233257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee5515-9ac2-4cb8-b1cb-2d3ea9b35a9a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:31.251084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38210256-232c-4c8d-8924-827df267a20b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:31.252782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 954/1937] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:10:31.265854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38210256-232c-4c8d-8924-827df267a20b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:31.270649 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2104-750f-4737-ba81-d059867fe8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:31.271315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2104-750f-4737-ba81-d059867fe8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:31.272228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2104-750f-4737-ba81-d059867fe8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:31.272557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2104-750f-4737-ba81-d059867fe8f5 admin admin] PATH_INFO: `/v3/projects/c60679f28db84c02af7a0c183996f40e/users/adac9912497842bea608931667697ec5/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:31.287843 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a2104-750f-4737-ba81-d059867fe8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60679f28db84c02af7a0c183996f40e, user_id=adac9912497842bea608931667697ec5, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:31.290555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a2104-750f-4737-ba81-d059867fe8f5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:31.398156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 984/1938] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:31 2022] PUT /identity/v3/projects/c60679f28db84c02af7a0c183996f40e/users/adac9912497842bea608931667697ec5/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:10:31.402417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee5515-9ac2-4cb8-b1cb-2d3ea9b35a9a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:31.413597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee5515-9ac2-4cb8-b1cb-2d3ea9b35a9a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:31.469684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c57b1-ed5c-4fce-b57f-06ce019ea75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:31.470332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c57b1-ed5c-4fce-b57f-06ce019ea75d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:31.470613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c57b1-ed5c-4fce-b57f-06ce019ea75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:31.470886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c57b1-ed5c-4fce-b57f-06ce019ea75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:31.471535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c57b1-ed5c-4fce-b57f-06ce019ea75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:31.473410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c57b1-ed5c-4fce-b57f-06ce019ea75d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:31.483889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 955/1939] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:31.488210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2104-750f-4737-ba81-d059867fe8f5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:31.499457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2104-750f-4737-ba81-d059867fe8f5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:31.504361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:31.505047 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:31.505333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:31.505754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] PATH_INFO: `/v3/projects/c60679f28db84c02af7a0c183996f40e/users/adac9912497842bea608931667697ec5/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:31.507881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60679f28db84c02af7a0c183996f40e, user_id=adac9912497842bea608931667697ec5, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:31.510662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:31.521968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 985/1940] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:31 2022] PUT /identity/v3/projects/c60679f28db84c02af7a0c183996f40e/users/adac9912497842bea608931667697ec5/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:31.532098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643cd4d-07cc-4bf7-8621-546ab8bf090d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:31.532607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643cd4d-07cc-4bf7-8621-546ab8bf090d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:31.532994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643cd4d-07cc-4bf7-8621-546ab8bf090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:31.561125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7643cd4d-07cc-4bf7-8621-546ab8bf090d None None] MFA Rules not processed for user `adac9912497842bea608931667697ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:31.562338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7643cd4d-07cc-4bf7-8621-546ab8bf090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:31.598839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:31.651768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 956/1941] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:31.660981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:31.663267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:31.726767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199c23d-69e4-44ef-8609-b90ec874131c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:31.730681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9aff9-5f17-4080-9bb6-00ead9bf7988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:31.737021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9aff9-5f17-4080-9bb6-00ead9bf7988 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:31.737360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9aff9-5f17-4080-9bb6-00ead9bf7988 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:31.737635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9aff9-5f17-4080-9bb6-00ead9bf7988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:31.752063 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9aff9-5f17-4080-9bb6-00ead9bf7988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:31.753640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9aff9-5f17-4080-9bb6-00ead9bf7988 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:31.769065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 986/1942] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:32.240614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643cd4d-07cc-4bf7-8621-546ab8bf090d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:32.242038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7643cd4d-07cc-4bf7-8621-546ab8bf090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:32.254905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643cd4d-07cc-4bf7-8621-546ab8bf090d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:32.258750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b97f6-4e4d-4a44-8ae2-4fbfaaa29a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:32.259391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b97f6-4e4d-4a44-8ae2-4fbfaaa29a16 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:32.259670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b97f6-4e4d-4a44-8ae2-4fbfaaa29a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:32.259944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b97f6-4e4d-4a44-8ae2-4fbfaaa29a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:32.328838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b97f6-4e4d-4a44-8ae2-4fbfaaa29a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:32.330175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b97f6-4e4d-4a44-8ae2-4fbfaaa29a16 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:32.340670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 957/1943] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:32 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:32.490853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9aff9-5f17-4080-9bb6-00ead9bf7988 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:32.517254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9aff9-5f17-4080-9bb6-00ead9bf7988 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:32.517254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb11df7-87ad-4807-94db-daf512493537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:32.517254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11df7-87ad-4807-94db-daf512493537 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:32.517254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11df7-87ad-4807-94db-daf512493537 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:32.517762 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11df7-87ad-4807-94db-daf512493537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:32.517762 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9eb11df7-87ad-4807-94db-daf512493537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:32.547126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:32.578790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb11df7-87ad-4807-94db-daf512493537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:32.580279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb11df7-87ad-4807-94db-daf512493537 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:32.590343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 987/1944] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:33.106015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474d80f-e8d8-484d-bc6c-dc8f34a12eb2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:33.106878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474d80f-e8d8-484d-bc6c-dc8f34a12eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:33.107165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474d80f-e8d8-484d-bc6c-dc8f34a12eb2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:33.108874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 958/1945] 10.222.0.75 () {54 vars in 921 bytes} [Mon Sep 19 15:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:10:33.122687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3949-bbe0-4b94-8f3c-c69140d4d4b0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:33.123049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3949-bbe0-4b94-8f3c-c69140d4d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:33.123696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c3949-bbe0-4b94-8f3c-c69140d4d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:33.165031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-657c3949-bbe0-4b94-8f3c-c69140d4d4b0 None None] MFA Rules not processed for user `ab4bb702760a4cd2b2cbf6f732b2360b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:33.166418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-657c3949-bbe0-4b94-8f3c-c69140d4d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:33.260265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 988/1946] 10.222.0.75 () {58 vars in 1018 bytes} [Mon Sep 19 15:10:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:33.280008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474d80f-e8d8-484d-bc6c-dc8f34a12eb2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:33.282620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3474d80f-e8d8-484d-bc6c-dc8f34a12eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:33.303168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474d80f-e8d8-484d-bc6c-dc8f34a12eb2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:33.308931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b6a4a-1334-458d-abac-faef157612af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:33.309669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b6a4a-1334-458d-abac-faef157612af service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:33.310014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b6a4a-1334-458d-abac-faef157612af service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:33.310356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b6a4a-1334-458d-abac-faef157612af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:33.321159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b6a4a-1334-458d-abac-faef157612af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:33.322790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b6a4a-1334-458d-abac-faef157612af service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:33.335408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 959/1947] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:43.249482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=46 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:43.330119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=47 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:50.799721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c3949-bbe0-4b94-8f3c-c69140d4d4b0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:50.875752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c3949-bbe0-4b94-8f3c-c69140d4d4b0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:50.880308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:50.880972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:50.881254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:50.881536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] PATH_INFO: `/v3/users/c6cee4f4ba7541778048c7231898c572` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:50.883421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cee4f4ba7541778048c7231898c572)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:50.885375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:51.108080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cee4f4ba7541778048c7231898c572'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:51.120778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cee4f4ba7541778048c7231898c572'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:51.127629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cee4f4ba7541778048c7231898c572'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:51.190895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cee4f4ba7541778048c7231898c572'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:51.191534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cee4f4ba7541778048c7231898c572'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:51.199262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 989/1948] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:50 2022] DELETE /identity/v3/users/c6cee4f4ba7541778048c7231898c572 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:51.203728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc980d-338b-4a48-9d34-a1f96b358eaf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:51.207286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc980d-338b-4a48-9d34-a1f96b358eaf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:51.207286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc980d-338b-4a48-9d34-a1f96b358eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:51.230251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-36cc980d-338b-4a48-9d34-a1f96b358eaf None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:51.232060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-36cc980d-338b-4a48-9d34-a1f96b358eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:51.293421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 960/1949] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:51.303089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:51.304546 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:51.362880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c50f2b-82d1-4528-b667-51a9eadff2c4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:51.366341 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97646-a058-47af-ac42-c0d8442c25dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:51.366955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97646-a058-47af-ac42-c0d8442c25dc service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:51.367224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97646-a058-47af-ac42-c0d8442c25dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:51.367494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97646-a058-47af-ac42-c0d8442c25dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:51.376392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa97646-a058-47af-ac42-c0d8442c25dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:51.377831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa97646-a058-47af-ac42-c0d8442c25dc service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:51.387048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 990/1950] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:10:51.819045 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc980d-338b-4a48-9d34-a1f96b358eaf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:51.821271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-36cc980d-338b-4a48-9d34-a1f96b358eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:51.836531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc980d-338b-4a48-9d34-a1f96b358eaf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:51.845375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:51.846186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:51.846473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:51.846753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] PATH_INFO: `/v3/projects/824c77a2c5dd453cadf0a273ab75f035` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:51.848317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824c77a2c5dd453cadf0a273ab75f035)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:51.850506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:51.968217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824c77a2c5dd453cadf0a273ab75f035', 'request_id': 'req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.034480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824c77a2c5dd453cadf0a273ab75f035', 'request_id': 'req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.041736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824c77a2c5dd453cadf0a273ab75f035', 'request_id': 'req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.053200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] The token cache is being invalidate because project 824c77a2c5dd453cadf0a273ab75f035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:52.053494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.054720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.056357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 961/1951] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:51 2022] DELETE /identity/v3/projects/824c77a2c5dd453cadf0a273ab75f035 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:52.060422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97646-a058-47af-ac42-c0d8442c25dc service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:52.071217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97646-a058-47af-ac42-c0d8442c25dc service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:52.090878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:52.131145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:52.132897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:52.132897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:52.133138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] PATH_INFO: `/v3/users/adac9912497842bea608931667697ec5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:52.134102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adac9912497842bea608931667697ec5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:52.136050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:52.331751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adac9912497842bea608931667697ec5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.345346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adac9912497842bea608931667697ec5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.353594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adac9912497842bea608931667697ec5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.434529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adac9912497842bea608931667697ec5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.435315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7519a21a-e735-47de-b29d-254a907c6851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adac9912497842bea608931667697ec5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:52.442572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 991/1952] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:10:52 2022] DELETE /identity/v3/users/adac9912497842bea608931667697ec5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:52.881889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:52.883511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:52.899994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d9106-866a-4ceb-b09a-31a0f7a1c8f5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:52.958213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:52.958847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:52.959141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:52.966008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] PATH_INFO: `/v3/projects/c60679f28db84c02af7a0c183996f40e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:52.966008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60679f28db84c02af7a0c183996f40e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:52.966008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:53.049224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:53.065345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60679f28db84c02af7a0c183996f40e', 'request_id': 'req-b89e4362-fedd-4800-9626-85a15caf84a7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:53.127398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60679f28db84c02af7a0c183996f40e', 'request_id': 'req-b89e4362-fedd-4800-9626-85a15caf84a7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:53.134452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60679f28db84c02af7a0c183996f40e', 'request_id': 'req-b89e4362-fedd-4800-9626-85a15caf84a7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:53.144934 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] The token cache is being invalidate because project c60679f28db84c02af7a0c183996f40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:10:53.145226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:53.145866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b89e4362-fedd-4800-9626-85a15caf84a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:10:53.147357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 962/1953] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:10:52 2022] DELETE /identity/v3/projects/c60679f28db84c02af7a0c183996f40e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:53.152927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e574a6-9077-47bb-9cc0-4e473e45880a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.153428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e574a6-9077-47bb-9cc0-4e473e45880a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.153519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e574a6-9077-47bb-9cc0-4e473e45880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.173486 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a2e574a6-9077-47bb-9cc0-4e473e45880a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:53.174677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a2e574a6-9077-47bb-9cc0-4e473e45880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:53.235413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 992/1954] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:53.248279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b2a3-b143-41a0-a901-3dbf9abf1e00 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.248279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b2a3-b143-41a0-a901-3dbf9abf1e00 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.248279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b2a3-b143-41a0-a901-3dbf9abf1e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.264082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fe38b2a3-b143-41a0-a901-3dbf9abf1e00 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:53.265344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fe38b2a3-b143-41a0-a901-3dbf9abf1e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:53.275254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 963/1955] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:53.279715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e574a6-9077-47bb-9cc0-4e473e45880a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:53.293015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e574a6-9077-47bb-9cc0-4e473e45880a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:53.298047 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:53.298732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.299089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.299472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.300208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:10:53.300616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:53.302312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:53.320134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 993/1956] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:10:53.324934 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38b2a3-b143-41a0-a901-3dbf9abf1e00 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:53.338011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38b2a3-b143-41a0-a901-3dbf9abf1e00 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:53.343123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870367c0-c2c0-4ab4-bf23-a7f41364b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:53.343745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870367c0-c2c0-4ab4-bf23-a7f41364b25e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.344029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870367c0-c2c0-4ab4-bf23-a7f41364b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.344337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870367c0-c2c0-4ab4-bf23-a7f41364b25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.345145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870367c0-c2c0-4ab4-bf23-a7f41364b25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:53.347038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870367c0-c2c0-4ab4-bf23-a7f41364b25e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:53.443219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 964/1957] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:53 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:53.448277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:53.458560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc7c31-e2dd-4adb-8075-0d2d48742514 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:53.485527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:53.522198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efb761-ab94-497c-bda5-b6aa9f167e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:53.522198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efb761-ab94-497c-bda5-b6aa9f167e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.522198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efb761-ab94-497c-bda5-b6aa9f167e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.522198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efb761-ab94-497c-bda5-b6aa9f167e52 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.524526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efb761-ab94-497c-bda5-b6aa9f167e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:53.526401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efb761-ab94-497c-bda5-b6aa9f167e52 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:53.607004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 994/1958] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:53 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:10:53.608256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870367c0-c2c0-4ab4-bf23-a7f41364b25e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:53.619669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870367c0-c2c0-4ab4-bf23-a7f41364b25e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:53.624712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dce01-af75-43cc-94e4-1cf32879b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:53.628371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dce01-af75-43cc-94e4-1cf32879b6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.628371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dce01-af75-43cc-94e4-1cf32879b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.628371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dce01-af75-43cc-94e4-1cf32879b6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.628371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dce01-af75-43cc-94e4-1cf32879b6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:53.628371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dce01-af75-43cc-94e4-1cf32879b6d1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:53.639164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 965/1959] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:10:53.643087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efb761-ab94-497c-bda5-b6aa9f167e52 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:53.654123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efb761-ab94-497c-bda5-b6aa9f167e52 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:53.658721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759a15-ebd4-47c5-bc9e-f4760b22e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:53.659330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759a15-ebd4-47c5-bc9e-f4760b22e2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.659612 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759a15-ebd4-47c5-bc9e-f4760b22e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.659886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759a15-ebd4-47c5-bc9e-f4760b22e2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.660561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759a15-ebd4-47c5-bc9e-f4760b22e2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:53.662160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45759a15-ebd4-47c5-bc9e-f4760b22e2a5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:53.675875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 995/1960] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:53.677256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dce01-af75-43cc-94e4-1cf32879b6d1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:53.687359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dce01-af75-43cc-94e4-1cf32879b6d1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:53.692083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ffe7b-d360-4ad0-afb7-6f93dc0240f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:53.692776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe7b-d360-4ad0-afb7-6f93dc0240f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.693057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe7b-d360-4ad0-afb7-6f93dc0240f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.693332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe7b-d360-4ad0-afb7-6f93dc0240f4 admin admin] PATH_INFO: `/v3/projects/2a0284d6d859439cb9fc76611b3d0ae5/users/6128c1ad4a334f728f0af77bd709197c/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.707917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ffe7b-d360-4ad0-afb7-6f93dc0240f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0284d6d859439cb9fc76611b3d0ae5, user_id=6128c1ad4a334f728f0af77bd709197c, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:53.711203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ffe7b-d360-4ad0-afb7-6f93dc0240f4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:53.820841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 966/1961] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:53 2022] PUT /identity/v3/projects/2a0284d6d859439cb9fc76611b3d0ae5/users/6128c1ad4a334f728f0af77bd709197c/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:53.831887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cf553-ed55-4cab-8b0a-385aab811cef None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:53.832171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cf553-ed55-4cab-8b0a-385aab811cef None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:53.832447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cf553-ed55-4cab-8b0a-385aab811cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:53.860553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-da9cf553-ed55-4cab-8b0a-385aab811cef None None] MFA Rules not processed for user `6128c1ad4a334f728f0af77bd709197c`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:53.861760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-da9cf553-ed55-4cab-8b0a-385aab811cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:53.928310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 996/1962] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:53.935885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ffe7b-d360-4ad0-afb7-6f93dc0240f4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:54.004378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ffe7b-d360-4ad0-afb7-6f93dc0240f4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:54.009184 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb14b-97d1-4331-a6e2-45d2551340c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:54.009802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb14b-97d1-4331-a6e2-45d2551340c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:54.010087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb14b-97d1-4331-a6e2-45d2551340c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:54.010366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb14b-97d1-4331-a6e2-45d2551340c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:54.011017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdb14b-97d1-4331-a6e2-45d2551340c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:54.012978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdb14b-97d1-4331-a6e2-45d2551340c0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:54.089429 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 967/1963] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:10:53 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:54.093495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cf553-ed55-4cab-8b0a-385aab811cef None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:54.105526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cf553-ed55-4cab-8b0a-385aab811cef None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:54.160303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec0f5f-182e-4661-867e-b695a5547309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:54.160932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0f5f-182e-4661-867e-b695a5547309 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:54.161207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0f5f-182e-4661-867e-b695a5547309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:54.161483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0f5f-182e-4661-867e-b695a5547309 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:54.162105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec0f5f-182e-4661-867e-b695a5547309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:54.164711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec0f5f-182e-4661-867e-b695a5547309 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:54.239032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 997/1964] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:10:54 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:10:54.240318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb14b-97d1-4331-a6e2-45d2551340c0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:54.251218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb14b-97d1-4331-a6e2-45d2551340c0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:54.256350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221411b7-ae84-40c3-8a18-a58640592924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:54.257155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221411b7-ae84-40c3-8a18-a58640592924 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:54.257501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221411b7-ae84-40c3-8a18-a58640592924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:54.257974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221411b7-ae84-40c3-8a18-a58640592924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:54.258752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221411b7-ae84-40c3-8a18-a58640592924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:54.261815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221411b7-ae84-40c3-8a18-a58640592924 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:54.280460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 968/1965] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:54.282567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec0f5f-182e-4661-867e-b695a5547309 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:54.293929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec0f5f-182e-4661-867e-b695a5547309 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:54.298657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabfffe-2ab2-4d0b-9bfe-3e6397d6277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:54.300610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabfffe-2ab2-4d0b-9bfe-3e6397d6277e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:54.300610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabfffe-2ab2-4d0b-9bfe-3e6397d6277e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:54.300610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabfffe-2ab2-4d0b-9bfe-3e6397d6277e admin admin] PATH_INFO: `/v3/projects/82f2a5f1f1944db08f25ba3091fb06a2/users/fa7a10fa9c2b4fe5a58e48789927ef0f/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:54.315854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabfffe-2ab2-4d0b-9bfe-3e6397d6277e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f2a5f1f1944db08f25ba3091fb06a2, user_id=fa7a10fa9c2b4fe5a58e48789927ef0f, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:54.318610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabfffe-2ab2-4d0b-9bfe-3e6397d6277e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:54.383441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 998/1966] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:54 2022] PUT /identity/v3/projects/82f2a5f1f1944db08f25ba3091fb06a2/users/fa7a10fa9c2b4fe5a58e48789927ef0f/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:54.387503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221411b7-ae84-40c3-8a18-a58640592924 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:54.398443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221411b7-ae84-40c3-8a18-a58640592924 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:54.418809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:54.458696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893dc86-9c20-4d1e-a589-f6491ba65f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:54.459321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893dc86-9c20-4d1e-a589-f6491ba65f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:54.459597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893dc86-9c20-4d1e-a589-f6491ba65f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:54.459875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893dc86-9c20-4d1e-a589-f6491ba65f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:54.461202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893dc86-9c20-4d1e-a589-f6491ba65f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:54.463043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893dc86-9c20-4d1e-a589-f6491ba65f3d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:54.476503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 969/1967] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:10:54.479591 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabfffe-2ab2-4d0b-9bfe-3e6397d6277e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:54.485123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:54.491191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabfffe-2ab2-4d0b-9bfe-3e6397d6277e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:54.496186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:54.496970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:54.497315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:54.497670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] PATH_INFO: `/v3/projects/82f2a5f1f1944db08f25ba3091fb06a2/users/fa7a10fa9c2b4fe5a58e48789927ef0f/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:54.499783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f2a5f1f1944db08f25ba3091fb06a2, user_id=fa7a10fa9c2b4fe5a58e48789927ef0f, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:54.502681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:54.515198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 999/1968] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:10:54 2022] PUT /identity/v3/projects/82f2a5f1f1944db08f25ba3091fb06a2/users/fa7a10fa9c2b4fe5a58e48789927ef0f/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:10:54.526672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502975-c557-44b7-a705-73d81f02f3c8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:54.527070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502975-c557-44b7-a705-73d81f02f3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:54.527417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502975-c557-44b7-a705-73d81f02f3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:54.558617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a4502975-c557-44b7-a705-73d81f02f3c8 None None] MFA Rules not processed for user `fa7a10fa9c2b4fe5a58e48789927ef0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:10:54.559531 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a4502975-c557-44b7-a705-73d81f02f3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:54.643828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 970/1969] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:10:54.655306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:10:54.657319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:10:54.719367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e69ffb-df27-4d8f-a67d-de7344a4d360 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:10:54.723347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de06c2-2ad5-4301-8b4f-5dd9184d29cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:10:54.723953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de06c2-2ad5-4301-8b4f-5dd9184d29cf service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:10:54.724236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de06c2-2ad5-4301-8b4f-5dd9184d29cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:10:54.724536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de06c2-2ad5-4301-8b4f-5dd9184d29cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:10:54.793597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de06c2-2ad5-4301-8b4f-5dd9184d29cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:10:54.795286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de06c2-2ad5-4301-8b4f-5dd9184d29cf service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:10:54.805343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1000/1970] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:10:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:02.203066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502975-c557-44b7-a705-73d81f02f3c8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:02.204578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a4502975-c557-44b7-a705-73d81f02f3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:02.289665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502975-c557-44b7-a705-73d81f02f3c8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:02.295720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:02.295720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:02.295720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:02.295720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] PATH_INFO: `/v3/users/9d867f5a9993405b87676d141a88a53a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:02.297044 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d867f5a9993405b87676d141a88a53a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:02.298973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:02.438764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de06c2-2ad5-4301-8b4f-5dd9184d29cf service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:02.448030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de06c2-2ad5-4301-8b4f-5dd9184d29cf service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:02.451985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771fd09-8e96-44de-ae32-7521d38ec7b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:02.452911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771fd09-8e96-44de-ae32-7521d38ec7b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:02.453025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771fd09-8e96-44de-ae32-7521d38ec7b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:02.453396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771fd09-8e96-44de-ae32-7521d38ec7b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:02.465187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771fd09-8e96-44de-ae32-7521d38ec7b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:02.466721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771fd09-8e96-44de-ae32-7521d38ec7b4 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:02.478418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1001/1971] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:02.498345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d867f5a9993405b87676d141a88a53a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:02.500964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:02.507702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d867f5a9993405b87676d141a88a53a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:02.523248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d867f5a9993405b87676d141a88a53a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:02.609994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d867f5a9993405b87676d141a88a53a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:02.610922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d867f5a9993405b87676d141a88a53a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:02.624079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 971/1972] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:02 2022] DELETE /identity/v3/users/9d867f5a9993405b87676d141a88a53a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:02.633096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf5789-a918-42c6-9c27-64774e240816 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:02.633563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf5789-a918-42c6-9c27-64774e240816 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:02.633893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf5789-a918-42c6-9c27-64774e240816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:02.706598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3bdf5789-a918-42c6-9c27-64774e240816 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:02.708600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3bdf5789-a918-42c6-9c27-64774e240816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:02.815722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1002/1973] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:02.826475 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:02.830143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:02.909761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70139e9-00d9-4031-a028-0d3a78a36d27 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:02.915376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7eda2-c3e5-48a4-9164-59be144f3b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:02.916767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7eda2-c3e5-48a4-9164-59be144f3b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:02.917140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7eda2-c3e5-48a4-9164-59be144f3b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:02.917504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7eda2-c3e5-48a4-9164-59be144f3b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:02.930935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7eda2-c3e5-48a4-9164-59be144f3b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:02.933348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7eda2-c3e5-48a4-9164-59be144f3b3a service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:02.948452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 972/1974] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:04.419924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf5789-a918-42c6-9c27-64774e240816 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:04.422213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3bdf5789-a918-42c6-9c27-64774e240816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:04.458816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf5789-a918-42c6-9c27-64774e240816 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:04.477637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:04.477637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:04.477637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:04.477637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] PATH_INFO: `/v3/projects/184ccc20c35445a2a048f630caafd78e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:04.478488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=184ccc20c35445a2a048f630caafd78e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:04.480411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:04.591137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:04.630086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184ccc20c35445a2a048f630caafd78e', 'request_id': 'req-f50b89bc-1c27-4b49-b753-00759573ce6c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:04.642875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184ccc20c35445a2a048f630caafd78e', 'request_id': 'req-f50b89bc-1c27-4b49-b753-00759573ce6c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:04.651677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184ccc20c35445a2a048f630caafd78e', 'request_id': 'req-f50b89bc-1c27-4b49-b753-00759573ce6c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:04.762667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] The token cache is being invalidate because project 184ccc20c35445a2a048f630caafd78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:04.763040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:04.764417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:04.768132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1003/1975] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:04 2022] DELETE /identity/v3/projects/184ccc20c35445a2a048f630caafd78e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:04.772150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7eda2-c3e5-48a4-9164-59be144f3b3a service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:04.801929 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7eda2-c3e5-48a4-9164-59be144f3b3a service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:04.953049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:04.953724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:04.954110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:04.954388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] PATH_INFO: `/v3/users/4efcb8c88d0f4ecaa61d4762e70e2958` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:04.957027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4efcb8c88d0f4ecaa61d4762e70e2958)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:04.959013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:05.193336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4efcb8c88d0f4ecaa61d4762e70e2958'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:05.204463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4efcb8c88d0f4ecaa61d4762e70e2958'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:05.219588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:05.222004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4efcb8c88d0f4ecaa61d4762e70e2958'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:05.334124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4efcb8c88d0f4ecaa61d4762e70e2958'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:05.336009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f8abbda3-a888-463d-a12f-f6d6b60ce43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4efcb8c88d0f4ecaa61d4762e70e2958'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:05.343924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 973/1976] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:04 2022] DELETE /identity/v3/users/4efcb8c88d0f4ecaa61d4762e70e2958 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:06.041581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:06.043549 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:06.059394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b89bc-1c27-4b49-b753-00759573ce6c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:06.163101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:06.165239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:06.165681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:06.166098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] PATH_INFO: `/v3/projects/9c18125ec15b4548a54ab42627c38469` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:06.167483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c18125ec15b4548a54ab42627c38469)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:06.170601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:06.301475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c18125ec15b4548a54ab42627c38469', 'request_id': 'req-dfe8aa7d-7481-48a7-9902-b505163d44a9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:06.309104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c18125ec15b4548a54ab42627c38469', 'request_id': 'req-dfe8aa7d-7481-48a7-9902-b505163d44a9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:06.321734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c18125ec15b4548a54ab42627c38469', 'request_id': 'req-dfe8aa7d-7481-48a7-9902-b505163d44a9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:06.429278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] The token cache is being invalidate because project 9c18125ec15b4548a54ab42627c38469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:06.429856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:06.431363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dfe8aa7d-7481-48a7-9902-b505163d44a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:06.434369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1004/1977] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:06 2022] DELETE /identity/v3/projects/9c18125ec15b4548a54ab42627c38469 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:06.439468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a6e1b-94db-4f36-a14b-850b41c2d243 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:06.440004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a6e1b-94db-4f36-a14b-850b41c2d243 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:06.440142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a6e1b-94db-4f36-a14b-850b41c2d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:06.465540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7a7a6e1b-94db-4f36-a14b-850b41c2d243 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:06.467016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a7a6e1b-94db-4f36-a14b-850b41c2d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:06.530567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 974/1978] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:06.540117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450fc0-c37f-49c8-9a28-fdcf76493fdd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:06.540430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450fc0-c37f-49c8-9a28-fdcf76493fdd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:06.540786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450fc0-c37f-49c8-9a28-fdcf76493fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:06.562079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-32450fc0-c37f-49c8-9a28-fdcf76493fdd None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:06.563340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-32450fc0-c37f-49c8-9a28-fdcf76493fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:06.572308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1005/1979] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:06.576598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a6e1b-94db-4f36-a14b-850b41c2d243 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:06.587803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a6e1b-94db-4f36-a14b-850b41c2d243 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:06.592761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:06.593386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:06.593670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:06.593946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:06.594632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:06.594944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:06.596610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:06.612974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 975/1980] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:11:06.614256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450fc0-c37f-49c8-9a28-fdcf76493fdd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:06.623964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450fc0-c37f-49c8-9a28-fdcf76493fdd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:06.628704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63997008-74e7-43c3-a188-e3eb0729ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:06.629416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997008-74e7-43c3-a188-e3eb0729ea32 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:06.629710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997008-74e7-43c3-a188-e3eb0729ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:06.630076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997008-74e7-43c3-a188-e3eb0729ea32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:06.630712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63997008-74e7-43c3-a188-e3eb0729ea32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:06.633207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63997008-74e7-43c3-a188-e3eb0729ea32 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:06.719721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1006/1981] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:06 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:06.721402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:06.737847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d585428-bf4e-4868-a530-146f8a3a00d8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:06.824770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7335ad-cf1e-4e8c-8762-a529a71229c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:06.825387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7335ad-cf1e-4e8c-8762-a529a71229c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:06.825962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7335ad-cf1e-4e8c-8762-a529a71229c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:06.826243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7335ad-cf1e-4e8c-8762-a529a71229c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:06.826877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7335ad-cf1e-4e8c-8762-a529a71229c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:06.829819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7335ad-cf1e-4e8c-8762-a529a71229c1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:06.947582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 976/1982] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:06 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:06.951430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63997008-74e7-43c3-a188-e3eb0729ea32 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:06.964343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63997008-74e7-43c3-a188-e3eb0729ea32 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:06.973991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322c4b6-2902-4520-80c2-0bd8ad403994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:06.973991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c4b6-2902-4520-80c2-0bd8ad403994 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:06.973991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c4b6-2902-4520-80c2-0bd8ad403994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:06.973991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322c4b6-2902-4520-80c2-0bd8ad403994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:06.974350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322c4b6-2902-4520-80c2-0bd8ad403994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:06.974350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322c4b6-2902-4520-80c2-0bd8ad403994 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:06.992554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1007/1983] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:06.994680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7335ad-cf1e-4e8c-8762-a529a71229c1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:07.005515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7335ad-cf1e-4e8c-8762-a529a71229c1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:07.011151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27c5fa-2394-4e5d-9bf4-650586807911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:07.012062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c5fa-2394-4e5d-9bf4-650586807911 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.012395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c5fa-2394-4e5d-9bf4-650586807911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.012995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c5fa-2394-4e5d-9bf4-650586807911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:07.013828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27c5fa-2394-4e5d-9bf4-650586807911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:07.018958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27c5fa-2394-4e5d-9bf4-650586807911 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:07.051735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 977/1984] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:07.053334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322c4b6-2902-4520-80c2-0bd8ad403994 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:07.062028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:07.066130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322c4b6-2902-4520-80c2-0bd8ad403994 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:07.071286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327e35b-0c6e-4c75-bb20-b5da69637767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:07.071962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327e35b-0c6e-4c75-bb20-b5da69637767 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.072253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327e35b-0c6e-4c75-bb20-b5da69637767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.072703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327e35b-0c6e-4c75-bb20-b5da69637767 admin admin] PATH_INFO: `/v3/projects/7f1b68145adb4967959b34cd58e2f3ec/users/f2e17bfc50844bc1aa5a211ecd0a383c/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:07.090239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327e35b-0c6e-4c75-bb20-b5da69637767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1b68145adb4967959b34cd58e2f3ec, user_id=f2e17bfc50844bc1aa5a211ecd0a383c, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:07.093411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327e35b-0c6e-4c75-bb20-b5da69637767 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:07.175258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1008/1985] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:07 2022] PUT /identity/v3/projects/7f1b68145adb4967959b34cd58e2f3ec/users/f2e17bfc50844bc1aa5a211ecd0a383c/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:07.186402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4537-26db-42de-ac65-26a786e9e72f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.186701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4537-26db-42de-ac65-26a786e9e72f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.186952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4537-26db-42de-ac65-26a786e9e72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:07.224143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e80b4537-26db-42de-ac65-26a786e9e72f None None] MFA Rules not processed for user `f2e17bfc50844bc1aa5a211ecd0a383c`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:07.225416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e80b4537-26db-42de-ac65-26a786e9e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:07.276642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:07.307738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 978/1986] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:07.308891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327e35b-0c6e-4c75-bb20-b5da69637767 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:07.404249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327e35b-0c6e-4c75-bb20-b5da69637767 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:07.410553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db8ef-341f-4203-a0b9-8dc706831c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:07.411455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db8ef-341f-4203-a0b9-8dc706831c64 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.411915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db8ef-341f-4203-a0b9-8dc706831c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.412339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db8ef-341f-4203-a0b9-8dc706831c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:07.414287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27db8ef-341f-4203-a0b9-8dc706831c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:07.416750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27db8ef-341f-4203-a0b9-8dc706831c64 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:07.555123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1009/1987] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:07 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:07.559367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b4537-26db-42de-ac65-26a786e9e72f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:07.571505 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b4537-26db-42de-ac65-26a786e9e72f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:07.657730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756ea7-625b-4ae4-b9d1-0996e7879e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:07.658373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756ea7-625b-4ae4-b9d1-0996e7879e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.658654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756ea7-625b-4ae4-b9d1-0996e7879e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.658938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756ea7-625b-4ae4-b9d1-0996e7879e66 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:07.659907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40756ea7-625b-4ae4-b9d1-0996e7879e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:07.661840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40756ea7-625b-4ae4-b9d1-0996e7879e66 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:07.794149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 979/1988] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:07 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:07.798866 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db8ef-341f-4203-a0b9-8dc706831c64 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:07.812099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db8ef-341f-4203-a0b9-8dc706831c64 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:07.817690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1964-b20e-49f3-928c-fd55f70bd92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:07.818482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1964-b20e-49f3-928c-fd55f70bd92d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.818845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1964-b20e-49f3-928c-fd55f70bd92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.819151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1964-b20e-49f3-928c-fd55f70bd92d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:07.820099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1964-b20e-49f3-928c-fd55f70bd92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:07.822497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1964-b20e-49f3-928c-fd55f70bd92d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:07.837067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1010/1989] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:07.841327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756ea7-625b-4ae4-b9d1-0996e7879e66 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:07.859260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756ea7-625b-4ae4-b9d1-0996e7879e66 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:07.880383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f423ee2-8d8a-4d37-bdd0-9dbd4b63c8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:07.881496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f423ee2-8d8a-4d37-bdd0-9dbd4b63c8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.882327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f423ee2-8d8a-4d37-bdd0-9dbd4b63c8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.882625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f423ee2-8d8a-4d37-bdd0-9dbd4b63c8e9 admin admin] PATH_INFO: `/v3/projects/5deade1af8824562a71cd6a3194c1e15/users/4ee3d96c08ba4fc5b638b1f0a1d0f84a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:07.912240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f423ee2-8d8a-4d37-bdd0-9dbd4b63c8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5deade1af8824562a71cd6a3194c1e15, user_id=4ee3d96c08ba4fc5b638b1f0a1d0f84a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:07.915836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f423ee2-8d8a-4d37-bdd0-9dbd4b63c8e9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:07.953920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08428e-d20f-43c0-aef0-fea6eaccb593 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.954291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08428e-d20f-43c0-aef0-fea6eaccb593 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.954642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08428e-d20f-43c0-aef0-fea6eaccb593 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:07.956409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1011/1990] 10.222.0.75 () {54 vars in 921 bytes} [Mon Sep 19 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:11:07.967874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681987-cbb7-4ca7-b362-7c5c00cbfb2c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:07.968367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681987-cbb7-4ca7-b362-7c5c00cbfb2c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:07.968703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681987-cbb7-4ca7-b362-7c5c00cbfb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:08.000806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b6681987-cbb7-4ca7-b362-7c5c00cbfb2c None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:08.001770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b6681987-cbb7-4ca7-b362-7c5c00cbfb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:08.034832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 980/1991] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:07 2022] PUT /identity/v3/projects/5deade1af8824562a71cd6a3194c1e15/users/4ee3d96c08ba4fc5b638b1f0a1d0f84a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:08.035951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f423ee2-8d8a-4d37-bdd0-9dbd4b63c8e9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:08.080527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1012/1992] 10.222.0.75 () {58 vars in 1018 bytes} [Mon Sep 19 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:08.092748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6681987-cbb7-4ca7-b362-7c5c00cbfb2c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:08.094697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b6681987-cbb7-4ca7-b362-7c5c00cbfb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:08.109218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6681987-cbb7-4ca7-b362-7c5c00cbfb2c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:08.115086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f423ee2-8d8a-4d37-bdd0-9dbd4b63c8e9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:08.116942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b9e3-fc8e-4fdb-bc80-ce74c86e83e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:08.117821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b9e3-fc8e-4fdb-bc80-ce74c86e83e5 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:08.118172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b9e3-fc8e-4fdb-bc80-ce74c86e83e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:08.118453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b9e3-fc8e-4fdb-bc80-ce74c86e83e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:08.119946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbf0fe-f18b-436e-a2fa-b6d5dfeab134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:08.120588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf0fe-f18b-436e-a2fa-b6d5dfeab134 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:08.120869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf0fe-f18b-436e-a2fa-b6d5dfeab134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:08.121140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf0fe-f18b-436e-a2fa-b6d5dfeab134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:08.122342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbf0fe-f18b-436e-a2fa-b6d5dfeab134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:08.124067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbf0fe-f18b-436e-a2fa-b6d5dfeab134 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:08.139652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 981/1993] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:08.141513 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009b9e3-fc8e-4fdb-bc80-ce74c86e83e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:08.142595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbf0fe-f18b-436e-a2fa-b6d5dfeab134 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:08.143779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009b9e3-fc8e-4fdb-bc80-ce74c86e83e5 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:08.154999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbf0fe-f18b-436e-a2fa-b6d5dfeab134 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:08.161576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1013/1994] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:08.161712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:08.161712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:08.166135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:08.166592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] PATH_INFO: `/v3/projects/5deade1af8824562a71cd6a3194c1e15/users/4ee3d96c08ba4fc5b638b1f0a1d0f84a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:08.169748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5deade1af8824562a71cd6a3194c1e15, user_id=4ee3d96c08ba4fc5b638b1f0a1d0f84a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:08.175359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:08.191459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 982/1995] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:08 2022] PUT /identity/v3/projects/5deade1af8824562a71cd6a3194c1e15/users/4ee3d96c08ba4fc5b638b1f0a1d0f84a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:08.206863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77578d-55f5-4473-8306-ae52f20808f3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:08.206863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77578d-55f5-4473-8306-ae52f20808f3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:08.206863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77578d-55f5-4473-8306-ae52f20808f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:08.238935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ce77578d-55f5-4473-8306-ae52f20808f3 None None] MFA Rules not processed for user `4ee3d96c08ba4fc5b638b1f0a1d0f84a`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:08.240212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ce77578d-55f5-4473-8306-ae52f20808f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:08.279862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:08.345504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1014/1996] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:08.364024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:08.365769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:08.434527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:08.462922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24eb29-5779-4d5e-b548-5936541dce53 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:08.467107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:08.467804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:08.468225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:08.468652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:08.480782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:08.482711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:08.495734 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 983/1997] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:08.649072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77578d-55f5-4473-8306-ae52f20808f3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:08.659115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77578d-55f5-4473-8306-ae52f20808f3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:08.663966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c50435-31b9-45a2-a9d4-2083ee084b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:08.664360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c50435-31b9-45a2-a9d4-2083ee084b1a service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:08.664971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c50435-31b9-45a2-a9d4-2083ee084b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:08.665263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c50435-31b9-45a2-a9d4-2083ee084b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:08.743075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c50435-31b9-45a2-a9d4-2083ee084b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:08.744857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c50435-31b9-45a2-a9d4-2083ee084b1a service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:08.762354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1015/1998] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:09.017982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:09.019551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:09.104286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab38fd-e51d-4679-8cd3-dd512cbfdeaf service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:09.109673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:09.110307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:09.110925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:09.110925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] PATH_INFO: `/v3/users/147ef96e0e6840d3b1bcebf1ce667242` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:09.111977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] RBAC: Authorizing `identity:delete_user(user_id=147ef96e0e6840d3b1bcebf1ce667242)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:09.114089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:09.356069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147ef96e0e6840d3b1bcebf1ce667242'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:09.377732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147ef96e0e6840d3b1bcebf1ce667242'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:09.395786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147ef96e0e6840d3b1bcebf1ce667242'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:09.514884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147ef96e0e6840d3b1bcebf1ce667242'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:09.515516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147ef96e0e6840d3b1bcebf1ce667242'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:09.522220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 984/1999] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:09 2022] DELETE /identity/v3/users/147ef96e0e6840d3b1bcebf1ce667242 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:09.814608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c50435-31b9-45a2-a9d4-2083ee084b1a service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:09.827739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c50435-31b9-45a2-a9d4-2083ee084b1a service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:09.915190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:09.915952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:09.916311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:09.916684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] PATH_INFO: `/v3/projects/62828c9d22654fd8a70793c11b7eac87` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:09.917882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=62828c9d22654fd8a70793c11b7eac87)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:09.919878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:10.103750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62828c9d22654fd8a70793c11b7eac87', 'request_id': 'req-996c1aa3-66bf-409c-ac8e-0971864a51dc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.109789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62828c9d22654fd8a70793c11b7eac87', 'request_id': 'req-996c1aa3-66bf-409c-ac8e-0971864a51dc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.118129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62828c9d22654fd8a70793c11b7eac87', 'request_id': 'req-996c1aa3-66bf-409c-ac8e-0971864a51dc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.120526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:10.224774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] The token cache is being invalidate because project 62828c9d22654fd8a70793c11b7eac87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:10.225147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.226232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.228148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1016/2000] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:09 2022] DELETE /identity/v3/projects/62828c9d22654fd8a70793c11b7eac87 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:10.232427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:10.234509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:10.249750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e1f8-9fda-422d-b527-e626bec6631b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:10.298195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:10.307489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:10.308110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:10.308388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:10.308694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] PATH_INFO: `/v3/users/fdda010b889e4676b7e4b14797668f68` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:10.309867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdda010b889e4676b7e4b14797668f68)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:10.311785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:10.553872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdda010b889e4676b7e4b14797668f68'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.560770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdda010b889e4676b7e4b14797668f68'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.573748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdda010b889e4676b7e4b14797668f68'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.621210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdda010b889e4676b7e4b14797668f68'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.621855 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdda010b889e4676b7e4b14797668f68'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:10.630294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 985/2001] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:10 2022] DELETE /identity/v3/users/fdda010b889e4676b7e4b14797668f68 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:10.791015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:10.792879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:10.816911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1aa3-66bf-409c-ac8e-0971864a51dc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:10.877704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:10.879280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:10.881840 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:10.883451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:10.883890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:10.884582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] PATH_INFO: `/v3/users/6128c1ad4a334f728f0af77bd709197c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:10.886756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6128c1ad4a334f728f0af77bd709197c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:10.890377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:10.895311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de9a9-8dd7-427e-bf36-5f0d15b5b97b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:10.901467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:10.902306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:10.905234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:10.905234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] PATH_INFO: `/v3/projects/34d8993994a64e948853901580be7ac3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:10.905234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d8993994a64e948853901580be7ac3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:10.906822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:11.118181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d8993994a64e948853901580be7ac3', 'request_id': 'req-40315f0a-bbb8-4d32-b823-f7143f84f831'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.118336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6128c1ad4a334f728f0af77bd709197c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.132657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6128c1ad4a334f728f0af77bd709197c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.139745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6128c1ad4a334f728f0af77bd709197c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.200885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d8993994a64e948853901580be7ac3', 'request_id': 'req-40315f0a-bbb8-4d32-b823-f7143f84f831'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.207533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d8993994a64e948853901580be7ac3', 'request_id': 'req-40315f0a-bbb8-4d32-b823-f7143f84f831'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.218871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] The token cache is being invalidate because project 34d8993994a64e948853901580be7ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:11.219162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.219810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-40315f0a-bbb8-4d32-b823-f7143f84f831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.221416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 986/2002] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:10 2022] DELETE /identity/v3/projects/34d8993994a64e948853901580be7ac3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:11.226962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4a453-1045-415a-8592-740d8ecda429 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.227264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4a453-1045-415a-8592-740d8ecda429 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.227524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4a453-1045-415a-8592-740d8ecda429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.247946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9da4a453-1045-415a-8592-740d8ecda429 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:11.250043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9da4a453-1045-415a-8592-740d8ecda429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:11.283019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6128c1ad4a334f728f0af77bd709197c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.283860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e2e1530-dc60-4730-a55b-a72b701e338b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6128c1ad4a334f728f0af77bd709197c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:11.294870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1017/2003] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:10 2022] DELETE /identity/v3/users/6128c1ad4a334f728f0af77bd709197c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:11.299136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1699b6-81b2-47a7-b982-186db1a13777 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.299469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1699b6-81b2-47a7-b982-186db1a13777 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.299742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1699b6-81b2-47a7-b982-186db1a13777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.315129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:11.320157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9c1699b6-81b2-47a7-b982-186db1a13777 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:11.321920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9c1699b6-81b2-47a7-b982-186db1a13777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:11.327830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 987/2004] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:11.337431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb75d-3d33-4c64-b9c4-a953bcbae979 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.337696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb75d-3d33-4c64-b9c4-a953bcbae979 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.337972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb75d-3d33-4c64-b9c4-a953bcbae979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.357865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b89fb75d-3d33-4c64-b9c4-a953bcbae979 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:11.359076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b89fb75d-3d33-4c64-b9c4-a953bcbae979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:11.384042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1018/2005] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:11.394059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1699b6-81b2-47a7-b982-186db1a13777 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:11.395400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9c1699b6-81b2-47a7-b982-186db1a13777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:11.409578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:11.418192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 988/2006] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:11.422348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb75d-3d33-4c64-b9c4-a953bcbae979 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:11.431881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb75d-3d33-4c64-b9c4-a953bcbae979 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:11.436538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:11.437145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.437426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.437705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.444065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:11.444065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:11.444065 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:11.455711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1699b6-81b2-47a7-b982-186db1a13777 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:11.456052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 989/2007] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:11:11.456952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:11.459858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9862b-4768-4e8b-9975-127a7d372826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:11.461502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9862b-4768-4e8b-9975-127a7d372826 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.461998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9862b-4768-4e8b-9975-127a7d372826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.462499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9862b-4768-4e8b-9975-127a7d372826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.467423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef3fe0-5817-472b-81a8-d07565fda40b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:11.472325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c885-0638-4e2e-9180-e448757febf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:11.472613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9862b-4768-4e8b-9975-127a7d372826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:11.473012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c885-0638-4e2e-9180-e448757febf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.473298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c885-0638-4e2e-9180-e448757febf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.473839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9c885-0638-4e2e-9180-e448757febf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.474477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9c885-0638-4e2e-9180-e448757febf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:11.474852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9862b-4768-4e8b-9975-127a7d372826 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:11.477035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9c885-0638-4e2e-9180-e448757febf0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:11.486881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1019/2008] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:11.562404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 990/2009] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:11 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:11.567844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9862b-4768-4e8b-9975-127a7d372826 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:11.578997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9862b-4768-4e8b-9975-127a7d372826 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:11.641355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6389865-c5b5-41f2-b21e-9a101bf732ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:11.641970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6389865-c5b5-41f2-b21e-9a101bf732ea admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.642251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6389865-c5b5-41f2-b21e-9a101bf732ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.642525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6389865-c5b5-41f2-b21e-9a101bf732ea admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.643154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6389865-c5b5-41f2-b21e-9a101bf732ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:11.645169 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6389865-c5b5-41f2-b21e-9a101bf732ea admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:11.734316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1020/2010] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:11 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:11.735622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c885-0638-4e2e-9180-e448757febf0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:11.749336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9c885-0638-4e2e-9180-e448757febf0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:11.757315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986908b1-bc88-4b33-9407-9a79d081133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:11.758025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986908b1-bc88-4b33-9407-9a79d081133f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.758368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986908b1-bc88-4b33-9407-9a79d081133f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.758700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986908b1-bc88-4b33-9407-9a79d081133f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.759421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986908b1-bc88-4b33-9407-9a79d081133f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:11.761110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986908b1-bc88-4b33-9407-9a79d081133f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:11.772132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 991/2011] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:11.777116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6389865-c5b5-41f2-b21e-9a101bf732ea admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:11.787918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6389865-c5b5-41f2-b21e-9a101bf732ea admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:11.793682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:11.794298 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.794582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.794995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.795494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:11.797498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:11.810307 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1021/2012] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:11.814710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986908b1-bc88-4b33-9407-9a79d081133f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:11.826419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986908b1-bc88-4b33-9407-9a79d081133f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:11.831617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebfa1c-2381-423b-bd5e-fa3682d6e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:11.835354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfa1c-2381-423b-bd5e-fa3682d6e755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.835354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfa1c-2381-423b-bd5e-fa3682d6e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.835354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfa1c-2381-423b-bd5e-fa3682d6e755 admin admin] PATH_INFO: `/v3/projects/6d0381a102ed479c8baca8f7dad55ae5/users/349cd1d77d064a6ebe3b066f4e7b3e75/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.850018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebfa1c-2381-423b-bd5e-fa3682d6e755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0381a102ed479c8baca8f7dad55ae5, user_id=349cd1d77d064a6ebe3b066f4e7b3e75, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:11.853445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebfa1c-2381-423b-bd5e-fa3682d6e755 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:11.954967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:11.956126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 992/2013] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:11 2022] PUT /identity/v3/projects/6d0381a102ed479c8baca8f7dad55ae5/users/349cd1d77d064a6ebe3b066f4e7b3e75/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:11.965816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fcb53-3e82-42de-9cb1-7a1c49c035c1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:11.966108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fcb53-3e82-42de-9cb1-7a1c49c035c1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:11.966391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fcb53-3e82-42de-9cb1-7a1c49c035c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:11.967008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:11.986233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0c382-5f8c-4d71-9951-5783aa21cd2b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:12.006608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9b5fcb53-3e82-42de-9cb1-7a1c49c035c1 None None] MFA Rules not processed for user `349cd1d77d064a6ebe3b066f4e7b3e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:12.008060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9b5fcb53-3e82-42de-9cb1-7a1c49c035c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:12.057626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:12.058399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:12.063737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:12.064041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] PATH_INFO: `/v3/projects/2a0284d6d859439cb9fc76611b3d0ae5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:12.065296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0284d6d859439cb9fc76611b3d0ae5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:12.067211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:12.076395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 993/2014] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:12.099591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fcb53-3e82-42de-9cb1-7a1c49c035c1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:12.103200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9b5fcb53-3e82-42de-9cb1-7a1c49c035c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:12.123931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:12.163067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fcb53-3e82-42de-9cb1-7a1c49c035c1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:12.167279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050dac-248e-4f77-8da0-69cd72c493c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:12.167886 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050dac-248e-4f77-8da0-69cd72c493c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:12.168164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050dac-248e-4f77-8da0-69cd72c493c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:12.168438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050dac-248e-4f77-8da0-69cd72c493c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:12.176613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050dac-248e-4f77-8da0-69cd72c493c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:12.178017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050dac-248e-4f77-8da0-69cd72c493c7 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:12.187429 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 994/2015] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:12.203692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:12.211136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050dac-248e-4f77-8da0-69cd72c493c7 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:12.214957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0284d6d859439cb9fc76611b3d0ae5', 'request_id': 'req-4ff64841-06cc-43f3-9091-3815d8f0a6fd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.220939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0284d6d859439cb9fc76611b3d0ae5', 'request_id': 'req-4ff64841-06cc-43f3-9091-3815d8f0a6fd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.222562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050dac-248e-4f77-8da0-69cd72c493c7 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:12.228677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0284d6d859439cb9fc76611b3d0ae5', 'request_id': 'req-4ff64841-06cc-43f3-9091-3815d8f0a6fd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.279571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:12.280207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:12.280517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:12.280797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] PATH_INFO: `/v3/users/349cd1d77d064a6ebe3b066f4e7b3e75` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:12.282032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349cd1d77d064a6ebe3b066f4e7b3e75)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:12.284107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:12.314158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] The token cache is being invalidate because project 2a0284d6d859439cb9fc76611b3d0ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:12.314482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.315127 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.316941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1022/2016] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:11 2022] DELETE /identity/v3/projects/2a0284d6d859439cb9fc76611b3d0ae5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:12.321456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:12.322748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:12.334988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64841-06cc-43f3-9091-3815d8f0a6fd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:12.341108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:12.341108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:12.341108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:12.341391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] PATH_INFO: `/v3/users/fa7a10fa9c2b4fe5a58e48789927ef0f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:12.342327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7a10fa9c2b4fe5a58e48789927ef0f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:12.344253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:12.470671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349cd1d77d064a6ebe3b066f4e7b3e75'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.478447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349cd1d77d064a6ebe3b066f4e7b3e75'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.490819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349cd1d77d064a6ebe3b066f4e7b3e75'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.566086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349cd1d77d064a6ebe3b066f4e7b3e75'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.566712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-62c92bea-1ddb-4afa-9dec-d17453ad6168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349cd1d77d064a6ebe3b066f4e7b3e75'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.576191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 995/2017] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:12 2022] DELETE /identity/v3/users/349cd1d77d064a6ebe3b066f4e7b3e75 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:12.580600 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e8d7-be9f-421e-821e-a9395b0ed55b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:12.581101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e8d7-be9f-421e-821e-a9395b0ed55b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:12.582195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e8d7-be9f-421e-821e-a9395b0ed55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:12.586896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7a10fa9c2b4fe5a58e48789927ef0f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.599647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7a10fa9c2b4fe5a58e48789927ef0f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.607477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7a10fa9c2b4fe5a58e48789927ef0f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.612788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6479e8d7-be9f-421e-821e-a9395b0ed55b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:12.613987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6479e8d7-be9f-421e-821e-a9395b0ed55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:12.648759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:12.675110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 996/2018] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:12.685454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e8d7-be9f-421e-821e-a9395b0ed55b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:12.686856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6479e8d7-be9f-421e-821e-a9395b0ed55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:12.688244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7a10fa9c2b4fe5a58e48789927ef0f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.689055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7a10fa9c2b4fe5a58e48789927ef0f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:12.696935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1023/2019] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:12 2022] DELETE /identity/v3/users/fa7a10fa9c2b4fe5a58e48789927ef0f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:12.746748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e8d7-be9f-421e-821e-a9395b0ed55b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:12.798673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:12.799437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:12.799712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:12.799983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:12.801801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:12.867149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:12.868591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:12.879907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 997/2020] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:13.192612 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:13.192612 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:13.210744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afc7cd-bea7-4f07-b024-869ad4d07647 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:13.217489 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:13.218638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.219013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.219449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] PATH_INFO: `/v3/projects/82f2a5f1f1944db08f25ba3091fb06a2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.220774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f2a5f1f1944db08f25ba3091fb06a2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:13.222830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:13.347619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f2a5f1f1944db08f25ba3091fb06a2', 'request_id': 'req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.353992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f2a5f1f1944db08f25ba3091fb06a2', 'request_id': 'req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.360566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f2a5f1f1944db08f25ba3091fb06a2', 'request_id': 'req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.369948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:13.371434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:13.384903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17647369-68b2-4acb-9c5f-1dbcc5ff837c service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:13.430909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:13.431955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] The token cache is being invalidate because project 82f2a5f1f1944db08f25ba3091fb06a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:13.432248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.433230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8258bd32-fdf3-4f5a-aa16-37e66c990a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.434780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1024/2021] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:13 2022] DELETE /identity/v3/projects/82f2a5f1f1944db08f25ba3091fb06a2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:13.440713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7e0d-40d1-4b12-9c5a-3f433671503d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.441000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7e0d-40d1-4b12-9c5a-3f433671503d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.441286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7e0d-40d1-4b12-9c5a-3f433671503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.447167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:13.453440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.453440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.453440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] PATH_INFO: `/v3/projects/6d0381a102ed479c8baca8f7dad55ae5` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.453440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0381a102ed479c8baca8f7dad55ae5)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:13.453440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:13.461896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9d3b7e0d-40d1-4b12-9c5a-3f433671503d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:13.463103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9d3b7e0d-40d1-4b12-9c5a-3f433671503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:13.471292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1025/2022] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:13.486244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126667a-2b8a-4abf-9e78-2d2f94ff82e1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.486244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126667a-2b8a-4abf-9e78-2d2f94ff82e1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.486491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126667a-2b8a-4abf-9e78-2d2f94ff82e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.509275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f126667a-2b8a-4abf-9e78-2d2f94ff82e1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:13.510484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f126667a-2b8a-4abf-9e78-2d2f94ff82e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:13.518451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1026/2023] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:13.522812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126667a-2b8a-4abf-9e78-2d2f94ff82e1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:13.528867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=22,keystone:SELECT=75,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:13.532550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126667a-2b8a-4abf-9e78-2d2f94ff82e1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:13.537702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:13.538859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.539264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.539774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.540435 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:13.543636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:13.543636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:13.553987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1027/2024] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:11:13.558560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:13.570731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99302134-7865-4195-93ed-f8e3d1880f65 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:13.588717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0381a102ed479c8baca8f7dad55ae5', 'request_id': 'req-286b02d3-e95e-477c-8519-46163be1a0da'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.648873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:13.650211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.652603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.652603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.652603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:13.654198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:13.672337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0381a102ed479c8baca8f7dad55ae5', 'request_id': 'req-286b02d3-e95e-477c-8519-46163be1a0da'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.679758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0381a102ed479c8baca8f7dad55ae5', 'request_id': 'req-286b02d3-e95e-477c-8519-46163be1a0da'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.690558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] The token cache is being invalidate because project 6d0381a102ed479c8baca8f7dad55ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:13.690848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.691508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-286b02d3-e95e-477c-8519-46163be1a0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:13.693091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 998/2025] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:13 2022] DELETE /identity/v3/projects/6d0381a102ed479c8baca8f7dad55ae5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:13.698487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59880-ad8d-4517-95fa-8b431a27ca4b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.698772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59880-ad8d-4517-95fa-8b431a27ca4b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.699047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59880-ad8d-4517-95fa-8b431a27ca4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.724866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a6b59880-ad8d-4517-95fa-8b431a27ca4b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:13.727166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a6b59880-ad8d-4517-95fa-8b431a27ca4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:13.736587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 999/2026] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:13.745153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed82928-debd-4793-b133-7f228be4c7d3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.749652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed82928-debd-4793-b133-7f228be4c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.749652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed82928-debd-4793-b133-7f228be4c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.766658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1ed82928-debd-4793-b133-7f228be4c7d3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:13.767867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1ed82928-debd-4793-b133-7f228be4c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:13.776010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1000/2027] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:13.780140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed82928-debd-4793-b133-7f228be4c7d3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:13.789393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed82928-debd-4793-b133-7f228be4c7d3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:13.794122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:13.794706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.794987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.795263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.796108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:13.796434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:13.798036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:13.810616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1001/2028] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:11:13.814453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1028/2029] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:13 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:13.814996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:13.815717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:13.817407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:13.826077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade6d03-056b-46d1-b2d4-3b52813d3f28 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:13.885553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e1e8c-6878-4d68-970b-074cc8f3583d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:13.889231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a54a1f-e21c-413c-b7e0-1566b0237f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:13.889850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a54a1f-e21c-413c-b7e0-1566b0237f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.890133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a54a1f-e21c-413c-b7e0-1566b0237f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.890427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb23d21-0693-4fd5-8aeb-d79007ece99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:13.890555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a54a1f-e21c-413c-b7e0-1566b0237f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.890987 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23d21-0693-4fd5-8aeb-d79007ece99d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:13.891088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a54a1f-e21c-413c-b7e0-1566b0237f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:13.891274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23d21-0693-4fd5-8aeb-d79007ece99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:13.891551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23d21-0693-4fd5-8aeb-d79007ece99d admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:13.892235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb23d21-0693-4fd5-8aeb-d79007ece99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:13.893008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a54a1f-e21c-413c-b7e0-1566b0237f98 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:13.894187 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb23d21-0693-4fd5-8aeb-d79007ece99d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:13.995357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1029/2030] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:13 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:13.995556 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1002/2031] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:13 2022] POST /identity/v3/projects => generated 359 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:13.997398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a54a1f-e21c-413c-b7e0-1566b0237f98 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:13.997521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb23d21-0693-4fd5-8aeb-d79007ece99d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.008560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb23d21-0693-4fd5-8aeb-d79007ece99d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.048885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:14.078767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a54a1f-e21c-413c-b7e0-1566b0237f98 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.083467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4a0cc-5456-4823-a6fc-fc24a55953f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.083649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372b97-d1da-4bfc-939a-e5ee46dbd10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.084082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a0cc-5456-4823-a6fc-fc24a55953f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.084264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372b97-d1da-4bfc-939a-e5ee46dbd10e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.084400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a0cc-5456-4823-a6fc-fc24a55953f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.084576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372b97-d1da-4bfc-939a-e5ee46dbd10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.084684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a0cc-5456-4823-a6fc-fc24a55953f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.084854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372b97-d1da-4bfc-939a-e5ee46dbd10e admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.086050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4a0cc-5456-4823-a6fc-fc24a55953f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.086324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372b97-d1da-4bfc-939a-e5ee46dbd10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.087669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4a0cc-5456-4823-a6fc-fc24a55953f7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.088297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372b97-d1da-4bfc-939a-e5ee46dbd10e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.097808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1030/2032] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:14.102605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4a0cc-5456-4823-a6fc-fc24a55953f7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.112301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4a0cc-5456-4823-a6fc-fc24a55953f7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.117016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec54b4f-db62-45bc-bd3d-381a6292bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.117601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec54b4f-db62-45bc-bd3d-381a6292bb82 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.117878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec54b4f-db62-45bc-bd3d-381a6292bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.118146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec54b4f-db62-45bc-bd3d-381a6292bb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.118774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec54b4f-db62-45bc-bd3d-381a6292bb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.120336 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec54b4f-db62-45bc-bd3d-381a6292bb82 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.130741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1031/2033] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:14.135506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec54b4f-db62-45bc-bd3d-381a6292bb82 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.144824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec54b4f-db62-45bc-bd3d-381a6292bb82 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.150105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7be87-ccdb-4fe4-8ec2-6278bba249de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.150708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7be87-ccdb-4fe4-8ec2-6278bba249de admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.150988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7be87-ccdb-4fe4-8ec2-6278bba249de admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.151263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7be87-ccdb-4fe4-8ec2-6278bba249de admin admin] PATH_INFO: `/v3/projects/29ecf911822248738aef833757aec2e1/users/076efce4d0b849848d325d9d49a1cdb9/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.164436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:14.168435 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7be87-ccdb-4fe4-8ec2-6278bba249de admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ecf911822248738aef833757aec2e1, user_id=076efce4d0b849848d325d9d49a1cdb9, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.172750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7be87-ccdb-4fe4-8ec2-6278bba249de admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.196165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1003/2034] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:13 2022] POST /identity/v3/users => generated 280 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:14.200052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372b97-d1da-4bfc-939a-e5ee46dbd10e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.209855 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372b97-d1da-4bfc-939a-e5ee46dbd10e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.215238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.215872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.216152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.216426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.217094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.218675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.230532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1004/2035] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:14.231489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.233251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:14.246746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc7375-8623-4f1c-b208-286f16913e2c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.249030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1032/2036] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:14 2022] PUT /identity/v3/projects/29ecf911822248738aef833757aec2e1/users/076efce4d0b849848d325d9d49a1cdb9/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:14.250699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7be87-ccdb-4fe4-8ec2-6278bba249de admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.306062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.306800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.306981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.307256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] PATH_INFO: `/v3/users/f2e17bfc50844bc1aa5a211ecd0a383c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.308462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e17bfc50844bc1aa5a211ecd0a383c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.310426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.318473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7be87-ccdb-4fe4-8ec2-6278bba249de admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.324112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a311-7fad-4aa9-b937-c05304187394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.324751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a311-7fad-4aa9-b937-c05304187394 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.325038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a311-7fad-4aa9-b937-c05304187394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.325427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a311-7fad-4aa9-b937-c05304187394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.326081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675a311-7fad-4aa9-b937-c05304187394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.327941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675a311-7fad-4aa9-b937-c05304187394 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.339356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1033/2037] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:14.340737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ba8d-ec8b-4bf9-9754-e593b78d5084 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.341010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ba8d-ec8b-4bf9-9754-e593b78d5084 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.341328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ba8d-ec8b-4bf9-9754-e593b78d5084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.370715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bfd2ba8d-ec8b-4bf9-9754-e593b78d5084 None None] MFA Rules not processed for user `076efce4d0b849848d325d9d49a1cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:14.371918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bfd2ba8d-ec8b-4bf9-9754-e593b78d5084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:14.437570 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1034/2038] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:14.438296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ba8d-ec8b-4bf9-9754-e593b78d5084 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.448662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ba8d-ec8b-4bf9-9754-e593b78d5084 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.453251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95d66c-84d0-4e81-bf21-1c9ff5028cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.453963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95d66c-84d0-4e81-bf21-1c9ff5028cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.454245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95d66c-84d0-4e81-bf21-1c9ff5028cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.454521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95d66c-84d0-4e81-bf21-1c9ff5028cb6 admin admin] PATH_INFO: `/v3/projects/02541e36612c4dd0b734dacbf6baa98f/users/bf06d898a297474d8746362b4acb0dd6/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.469781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95d66c-84d0-4e81-bf21-1c9ff5028cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02541e36612c4dd0b734dacbf6baa98f, user_id=bf06d898a297474d8746362b4acb0dd6, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.472499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95d66c-84d0-4e81-bf21-1c9ff5028cb6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.529803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e17bfc50844bc1aa5a211ecd0a383c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:14.537643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e17bfc50844bc1aa5a211ecd0a383c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:14.550700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e17bfc50844bc1aa5a211ecd0a383c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:14.591767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1035/2039] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:14 2022] PUT /identity/v3/projects/02541e36612c4dd0b734dacbf6baa98f/users/bf06d898a297474d8746362b4acb0dd6/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:14.592645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95d66c-84d0-4e81-bf21-1c9ff5028cb6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.613839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e17bfc50844bc1aa5a211ecd0a383c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:14.614590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0cf92e1d-e328-494e-a772-4a919d6178f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e17bfc50844bc1aa5a211ecd0a383c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:14.622424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1005/2040] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:14 2022] DELETE /identity/v3/users/f2e17bfc50844bc1aa5a211ecd0a383c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:14.624240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6925d-bdbb-4210-ba33-2ef4c55cdf0c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.624562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6925d-bdbb-4210-ba33-2ef4c55cdf0c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.624847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6925d-bdbb-4210-ba33-2ef4c55cdf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.626317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:14.654878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-45e6925d-bdbb-4210-ba33-2ef4c55cdf0c None None] MFA Rules not processed for user `bf06d898a297474d8746362b4acb0dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:14.656091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-45e6925d-bdbb-4210-ba33-2ef4c55cdf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:14.673339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95d66c-84d0-4e81-bf21-1c9ff5028cb6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.678458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:14.735956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1006/2041] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:14.737414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db1d1-9af6-4229-b5cf-68575b6976dc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.738255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db1d1-9af6-4229-b5cf-68575b6976dc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.738585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db1d1-9af6-4229-b5cf-68575b6976dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.757183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.757812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.758093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.758364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.758996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.760989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.766926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5a2db1d1-9af6-4229-b5cf-68575b6976dc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:14.769513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5a2db1d1-9af6-4229-b5cf-68575b6976dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:14.779993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1007/2042] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:14.779993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2db1d1-9af6-4229-b5cf-68575b6976dc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.786843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5a2db1d1-9af6-4229-b5cf-68575b6976dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:14.838827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2db1d1-9af6-4229-b5cf-68575b6976dc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.842393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.842996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.843273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.843545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.852691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.854120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.862358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1036/2043] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:14 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:14.863414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.863528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1008/2044] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:14.867521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:14.870830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:14.871401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:14.887722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33303bd3-66cf-4229-a973-75688a8563d9 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.931152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9cd7f-f723-4a41-abdd-fcc143f10d78 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:14.934856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.935467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.935758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.936062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.948836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2f84f-03ed-4e14-bc24-6bcae8efdf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:14.949421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f84f-03ed-4e14-bc24-6bcae8efdf8b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:14.949704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f84f-03ed-4e14-bc24-6bcae8efdf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:14.949978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f84f-03ed-4e14-bc24-6bcae8efdf8b admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:14.950612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2f84f-03ed-4e14-bc24-6bcae8efdf8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.952593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2f84f-03ed-4e14-bc24-6bcae8efdf8b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:14.997779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:14.998806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.008535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1037/2045] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:15.009466 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.010867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:15.022825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51199572-6955-4648-a521-d224ad755d90 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.027661 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.028299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.028630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.028909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] PATH_INFO: `/v3/users/bf06d898a297474d8746362b4acb0dd6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.030095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf06d898a297474d8746362b4acb0dd6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.032013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.036708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:15.055411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1009/2046] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:14 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:15.059606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2f84f-03ed-4e14-bc24-6bcae8efdf8b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.069932 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2f84f-03ed-4e14-bc24-6bcae8efdf8b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.074678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae68c66-e77f-45de-beb7-afc3c4c427ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.075366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae68c66-e77f-45de-beb7-afc3c4c427ab admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.075859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae68c66-e77f-45de-beb7-afc3c4c427ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.076136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae68c66-e77f-45de-beb7-afc3c4c427ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.076997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae68c66-e77f-45de-beb7-afc3c4c427ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.078585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae68c66-e77f-45de-beb7-afc3c4c427ab admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.089417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1010/2047] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:15.093925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae68c66-e77f-45de-beb7-afc3c4c427ab admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.106538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae68c66-e77f-45de-beb7-afc3c4c427ab admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.111305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35750cd-0f6f-49c0-9c7e-48f0e6949bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.111967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35750cd-0f6f-49c0-9c7e-48f0e6949bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.112243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35750cd-0f6f-49c0-9c7e-48f0e6949bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.112609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35750cd-0f6f-49c0-9c7e-48f0e6949bbe admin admin] PATH_INFO: `/v3/projects/3716e2ea915f424c8e09a13a0b144af5/users/a59459f47f5c4553b220595b1a66d7dd/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.127812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35750cd-0f6f-49c0-9c7e-48f0e6949bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3716e2ea915f424c8e09a13a0b144af5, user_id=a59459f47f5c4553b220595b1a66d7dd, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.130619 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35750cd-0f6f-49c0-9c7e-48f0e6949bbe admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.221039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1011/2048] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:15 2022] PUT /identity/v3/projects/3716e2ea915f424c8e09a13a0b144af5/users/a59459f47f5c4553b220595b1a66d7dd/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:15.223058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35750cd-0f6f-49c0-9c7e-48f0e6949bbe admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.228750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf06d898a297474d8746362b4acb0dd6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.238679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:15.247825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf06d898a297474d8746362b4acb0dd6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.256791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf06d898a297474d8746362b4acb0dd6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.292381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35750cd-0f6f-49c0-9c7e-48f0e6949bbe admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.297239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed99f63-959a-496f-b7f5-18193a4dd9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.297858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed99f63-959a-496f-b7f5-18193a4dd9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.298142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed99f63-959a-496f-b7f5-18193a4dd9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.298414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed99f63-959a-496f-b7f5-18193a4dd9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.299050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed99f63-959a-496f-b7f5-18193a4dd9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.300672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed99f63-959a-496f-b7f5-18193a4dd9f7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.311637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1012/2049] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:15.315864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed99f63-959a-496f-b7f5-18193a4dd9f7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.326132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf06d898a297474d8746362b4acb0dd6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.326489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed99f63-959a-496f-b7f5-18193a4dd9f7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.326837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-039be005-a4cf-4e09-908f-6f46bfb1be3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf06d898a297474d8746362b4acb0dd6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.331500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80418b5-ed7e-48cc-ab33-3d1099ec380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.332166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80418b5-ed7e-48cc-ab33-3d1099ec380e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.332569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80418b5-ed7e-48cc-ab33-3d1099ec380e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.333882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80418b5-ed7e-48cc-ab33-3d1099ec380e admin admin] PATH_INFO: `/v3/projects/3716e2ea915f424c8e09a13a0b144af5/users/a59459f47f5c4553b220595b1a66d7dd/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.334326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1038/2050] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:15 2022] DELETE /identity/v3/users/bf06d898a297474d8746362b4acb0dd6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:15.334865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80418b5-ed7e-48cc-ab33-3d1099ec380e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3716e2ea915f424c8e09a13a0b144af5, user_id=a59459f47f5c4553b220595b1a66d7dd, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.338666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80418b5-ed7e-48cc-ab33-3d1099ec380e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.339484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d834e-9818-4db3-9c68-1ac5c44b73f2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.339873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d834e-9818-4db3-9c68-1ac5c44b73f2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.340252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d834e-9818-4db3-9c68-1ac5c44b73f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.351380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1013/2051] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:15 2022] PUT /identity/v3/projects/3716e2ea915f424c8e09a13a0b144af5/users/a59459f47f5c4553b220595b1a66d7dd/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:15.361667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2fad-9f00-44c6-8957-07e7b5a82a77 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.362084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2fad-9f00-44c6-8957-07e7b5a82a77 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.362465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2fad-9f00-44c6-8957-07e7b5a82a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.363980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8d0d834e-9818-4db3-9c68-1ac5c44b73f2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:15.365255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8d0d834e-9818-4db3-9c68-1ac5c44b73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:15.396344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3e4e2fad-9f00-44c6-8957-07e7b5a82a77 None None] MFA Rules not processed for user `a59459f47f5c4553b220595b1a66d7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:15.397715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3e4e2fad-9f00-44c6-8957-07e7b5a82a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:15.437401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1039/2052] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:15.458813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d834e-9818-4db3-9c68-1ac5c44b73f2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.460024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8d0d834e-9818-4db3-9c68-1ac5c44b73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:15.472911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1014/2053] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:15.474043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e2fad-9f00-44c6-8957-07e7b5a82a77 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.475673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3e4e2fad-9f00-44c6-8957-07e7b5a82a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:15.497784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e2fad-9f00-44c6-8957-07e7b5a82a77 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.504677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.505342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.505628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.505904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] PATH_INFO: `/v3/projects/7f1b68145adb4967959b34cd58e2f3ec` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.507139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1b68145adb4967959b34cd58e2f3ec)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.509832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.528300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d834e-9818-4db3-9c68-1ac5c44b73f2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.532057 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.532690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.533128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.533306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.542474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.544358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.554366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1040/2054] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:15.555196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.556452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:15.588194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:15.629821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1b68145adb4967959b34cd58e2f3ec', 'request_id': 'req-49751524-bcc4-4bbc-817e-83470f96670a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.638299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b416c-f8ab-4067-950e-170ffe5d1489 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.687090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.687695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.687981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.688257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.690079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:15.694149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1b68145adb4967959b34cd58e2f3ec', 'request_id': 'req-49751524-bcc4-4bbc-817e-83470f96670a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.701583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1b68145adb4967959b34cd58e2f3ec', 'request_id': 'req-49751524-bcc4-4bbc-817e-83470f96670a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.712944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] The token cache is being invalidate because project 7f1b68145adb4967959b34cd58e2f3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:15.713244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.713920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:15.718615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1015/2055] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:15 2022] DELETE /identity/v3/projects/7f1b68145adb4967959b34cd58e2f3ec => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:15.719421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:15.721135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:15.733389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:15.766036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.767648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:15.806616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1041/2056] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:15.833833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751524-bcc4-4bbc-817e-83470f96670a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:15.841453 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:15.842176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:15.842739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:15.842850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] PATH_INFO: `/v3/users/4ee3d96c08ba4fc5b638b1f0a1d0f84a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:15.844078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee3d96c08ba4fc5b638b1f0a1d0f84a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:15.846355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.010451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:16.011899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:16.031572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024f244-cf3b-4ba9-a79d-b55689086b1b service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:16.036896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:16.037535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.037820 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.038092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] PATH_INFO: `/v3/projects/02541e36612c4dd0b734dacbf6baa98f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.039346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] RBAC: Authorizing `identity:delete_project(project_id=02541e36612c4dd0b734dacbf6baa98f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:16.042263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.043785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee3d96c08ba4fc5b638b1f0a1d0f84a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.053637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee3d96c08ba4fc5b638b1f0a1d0f84a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.068758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee3d96c08ba4fc5b638b1f0a1d0f84a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.134787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee3d96c08ba4fc5b638b1f0a1d0f84a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.135445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f1c57dca-68f9-42b6-867e-b74a6c29b8f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee3d96c08ba4fc5b638b1f0a1d0f84a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.142921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1016/2057] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:15 2022] DELETE /identity/v3/users/4ee3d96c08ba4fc5b638b1f0a1d0f84a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:16.156362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02541e36612c4dd0b734dacbf6baa98f', 'request_id': 'req-b4618aa6-afe7-4678-8fac-253ef0fe403b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.163087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02541e36612c4dd0b734dacbf6baa98f', 'request_id': 'req-b4618aa6-afe7-4678-8fac-253ef0fe403b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.169906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02541e36612c4dd0b734dacbf6baa98f', 'request_id': 'req-b4618aa6-afe7-4678-8fac-253ef0fe403b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.265098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] The token cache is being invalidate because project 02541e36612c4dd0b734dacbf6baa98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:16.266078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.266078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4618aa6-afe7-4678-8fac-253ef0fe403b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.270015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1042/2058] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:16 2022] DELETE /identity/v3/projects/02541e36612c4dd0b734dacbf6baa98f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:16.274825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e8d0e-6fd2-4fbc-bc0f-6976cdf3168f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.275134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e8d0e-6fd2-4fbc-bc0f-6976cdf3168f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.275411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e8d0e-6fd2-4fbc-bc0f-6976cdf3168f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.301739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ec3e8d0e-6fd2-4fbc-bc0f-6976cdf3168f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:16.302952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ec3e8d0e-6fd2-4fbc-bc0f-6976cdf3168f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:16.364705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1017/2059] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:16.373098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f109-7bdb-425f-9de6-7854eb5495c5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.373494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f109-7bdb-425f-9de6-7854eb5495c5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.373771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f109-7bdb-425f-9de6-7854eb5495c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.395304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-53b5f109-7bdb-425f-9de6-7854eb5495c5 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:16.396896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-53b5f109-7bdb-425f-9de6-7854eb5495c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:16.406188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1043/2060] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:16.410135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e8d0e-6fd2-4fbc-bc0f-6976cdf3168f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:16.426493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e8d0e-6fd2-4fbc-bc0f-6976cdf3168f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:16.439177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:16.439864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.440233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.440547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.441237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:16.441544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:16.443504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.458795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1018/2061] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:11:16.463396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5f109-7bdb-425f-9de6-7854eb5495c5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:16.473098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5f109-7bdb-425f-9de6-7854eb5495c5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:16.480138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:16.480437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.480753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.481704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.481704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:16.483655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.496429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:16.565460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1044/2062] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:16 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:16.570519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:16.598459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01092c2-0275-4c8d-83bd-e34f18c2d38d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:16.604584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:16.655193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51861b-a734-471c-943c-873e039cc5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:16.655885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51861b-a734-471c-943c-873e039cc5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.656129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51861b-a734-471c-943c-873e039cc5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.656408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51861b-a734-471c-943c-873e039cc5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.657142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51861b-a734-471c-943c-873e039cc5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:16.659050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51861b-a734-471c-943c-873e039cc5a2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.712097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:16.713893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:16.729070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6df4-f93e-40a1-9cfa-d6ca2b3aa330 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:16.734110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:16.734751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.735118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.735320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] PATH_INFO: `/v3/projects/5deade1af8824562a71cd6a3194c1e15` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.736556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5deade1af8824562a71cd6a3194c1e15)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:16.741991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.742405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1019/2063] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:16 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:16.744346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51861b-a734-471c-943c-873e039cc5a2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:16.754971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51861b-a734-471c-943c-873e039cc5a2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:16.759885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1014c-b915-4283-94b3-6b60a1ae88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:16.760558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1014c-b915-4283-94b3-6b60a1ae88c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.760846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1014c-b915-4283-94b3-6b60a1ae88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.761133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1014c-b915-4283-94b3-6b60a1ae88c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.761767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1014c-b915-4283-94b3-6b60a1ae88c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:16.763362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1014c-b915-4283-94b3-6b60a1ae88c6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.777927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1020/2064] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:16.778977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1014c-b915-4283-94b3-6b60a1ae88c6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:16.789972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1014c-b915-4283-94b3-6b60a1ae88c6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:16.795618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3799f4-3be2-43ca-87d0-8264c3151500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:16.796223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3799f4-3be2-43ca-87d0-8264c3151500 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.797730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3799f4-3be2-43ca-87d0-8264c3151500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.798026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3799f4-3be2-43ca-87d0-8264c3151500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.798673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3799f4-3be2-43ca-87d0-8264c3151500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:16.800318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3799f4-3be2-43ca-87d0-8264c3151500 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.811082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1021/2065] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:16.815210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3799f4-3be2-43ca-87d0-8264c3151500 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:16.825091 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3799f4-3be2-43ca-87d0-8264c3151500 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:16.829745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009405-54d4-4265-bc03-2ed8681f4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:16.830405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009405-54d4-4265-bc03-2ed8681f4566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:16.830686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009405-54d4-4265-bc03-2ed8681f4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:16.830963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009405-54d4-4265-bc03-2ed8681f4566 admin admin] PATH_INFO: `/v3/projects/93ed315c5ea149f39d79219c71f7dbef/users/91c3f08b05024cfcb57238b4f1e55b8a/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:16.854434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64009405-54d4-4265-bc03-2ed8681f4566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ed315c5ea149f39d79219c71f7dbef, user_id=91c3f08b05024cfcb57238b4f1e55b8a, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:16.858019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64009405-54d4-4265-bc03-2ed8681f4566 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:16.876800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5deade1af8824562a71cd6a3194c1e15', 'request_id': 'req-08d85291-c31b-42ac-b76f-b309b63a98fc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.884457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5deade1af8824562a71cd6a3194c1e15', 'request_id': 'req-08d85291-c31b-42ac-b76f-b309b63a98fc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.891138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5deade1af8824562a71cd6a3194c1e15', 'request_id': 'req-08d85291-c31b-42ac-b76f-b309b63a98fc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.998862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] The token cache is being invalidate because project 5deade1af8824562a71cd6a3194c1e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:16.999158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:16.999885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-08d85291-c31b-42ac-b76f-b309b63a98fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:17.001659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1045/2067] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:16 2022] DELETE /identity/v3/projects/5deade1af8824562a71cd6a3194c1e15 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:17.006135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc89b-2b12-4a47-a04c-e9a259a8ec7a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.006437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc89b-2b12-4a47-a04c-e9a259a8ec7a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.006806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc89b-2b12-4a47-a04c-e9a259a8ec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.009525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1022/2067] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:16 2022] PUT /identity/v3/projects/93ed315c5ea149f39d79219c71f7dbef/users/91c3f08b05024cfcb57238b4f1e55b8a/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:17.010983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc26024-ef66-40c7-9dd8-e69ec97caad2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.011270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc26024-ef66-40c7-9dd8-e69ec97caad2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.011545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc26024-ef66-40c7-9dd8-e69ec97caad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.029021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-624fc89b-2b12-4a47-a04c-e9a259a8ec7a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:17.030271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-624fc89b-2b12-4a47-a04c-e9a259a8ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:17.045640 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ddc26024-ef66-40c7-9dd8-e69ec97caad2 None None] MFA Rules not processed for user `91c3f08b05024cfcb57238b4f1e55b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:17.047074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ddc26024-ef66-40c7-9dd8-e69ec97caad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:17.092229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1046/2068] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:17.100448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02250cb-3e39-47bc-b5eb-ebef93def065 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.101285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02250cb-3e39-47bc-b5eb-ebef93def065 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.101566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02250cb-3e39-47bc-b5eb-ebef93def065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.118423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1023/2069] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:17.121858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f02250cb-3e39-47bc-b5eb-ebef93def065 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:17.126904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f02250cb-3e39-47bc-b5eb-ebef93def065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:17.131204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1047/2070] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:17.135592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc26024-ef66-40c7-9dd8-e69ec97caad2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.136714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02250cb-3e39-47bc-b5eb-ebef93def065 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.138055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f02250cb-3e39-47bc-b5eb-ebef93def065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:17.146443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc26024-ef66-40c7-9dd8-e69ec97caad2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.151509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:17.152124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.152437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.152759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.154803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:17.155111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:17.156728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:17.172416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1024/2071] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:11:17.173891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.185278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919538-f889-4e4d-8ef8-8a1ddd44c2f3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.190490 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a2e84-be2a-4979-9407-1f5322e74881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:17.195143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2e84-be2a-4979-9407-1f5322e74881 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.195143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2e84-be2a-4979-9407-1f5322e74881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.195143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2e84-be2a-4979-9407-1f5322e74881 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.195143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a2e84-be2a-4979-9407-1f5322e74881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:17.195143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a2e84-be2a-4979-9407-1f5322e74881 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:17.198137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02250cb-3e39-47bc-b5eb-ebef93def065 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.201809 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:17.202413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.202696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.202970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.212377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:17.213852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:17.222972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1048/2072] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:17.249750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.251166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:17.265521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a5e5f-58f4-4702-a2e1-95cb742fe9e8 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.270135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:17.270751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.271033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.271310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] PATH_INFO: `/v3/users/91c3f08b05024cfcb57238b4f1e55b8a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.272440 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c3f08b05024cfcb57238b4f1e55b8a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:17.274391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:17.279263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:17.287199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1025/2073] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:17.288925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a2e84-be2a-4979-9407-1f5322e74881 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.297867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:17.350277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a2e84-be2a-4979-9407-1f5322e74881 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.355590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcaf81-ca7a-4e9f-9190-4b5f6133a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:17.356195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcaf81-ca7a-4e9f-9190-4b5f6133a16a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.356497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcaf81-ca7a-4e9f-9190-4b5f6133a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.356837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcaf81-ca7a-4e9f-9190-4b5f6133a16a admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.357493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcaf81-ca7a-4e9f-9190-4b5f6133a16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:17.359426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcaf81-ca7a-4e9f-9190-4b5f6133a16a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:17.484375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1026/2074] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:17 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:17.488765 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcaf81-ca7a-4e9f-9190-4b5f6133a16a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.496651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c3f08b05024cfcb57238b4f1e55b8a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:17.504279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcaf81-ca7a-4e9f-9190-4b5f6133a16a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.510274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e756d0-e092-4310-9305-6e1fd445b277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:17.511182 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e756d0-e092-4310-9305-6e1fd445b277 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.511313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e756d0-e092-4310-9305-6e1fd445b277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.511572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e756d0-e092-4310-9305-6e1fd445b277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.512218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e756d0-e092-4310-9305-6e1fd445b277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:17.513892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e756d0-e092-4310-9305-6e1fd445b277 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:17.570838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c3f08b05024cfcb57238b4f1e55b8a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:17.570978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1027/2075] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:17.571075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c3f08b05024cfcb57238b4f1e55b8a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:17.571166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e756d0-e092-4310-9305-6e1fd445b277 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.571166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e756d0-e092-4310-9305-6e1fd445b277 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.571166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4442df7-d7ae-49b2-941f-7f35a02e7ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:17.571166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442df7-d7ae-49b2-941f-7f35a02e7ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.571536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442df7-d7ae-49b2-941f-7f35a02e7ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.571536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442df7-d7ae-49b2-941f-7f35a02e7ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.571536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4442df7-d7ae-49b2-941f-7f35a02e7ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:17.571536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4442df7-d7ae-49b2-941f-7f35a02e7ea8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:17.571536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1028/2076] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:17.571536 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4442df7-d7ae-49b2-941f-7f35a02e7ea8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.578730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4442df7-d7ae-49b2-941f-7f35a02e7ea8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.583438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e9672-c779-415a-8d7a-f62b3f44dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:17.584138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9672-c779-415a-8d7a-f62b3f44dbb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.584419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9672-c779-415a-8d7a-f62b3f44dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.584736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9672-c779-415a-8d7a-f62b3f44dbb4 admin admin] PATH_INFO: `/v3/projects/ffcb82d647a143d5be28157af729028c/users/a6a12152836f4134b795b07e479fe806/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.601849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e9672-c779-415a-8d7a-f62b3f44dbb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcb82d647a143d5be28157af729028c, user_id=a6a12152836f4134b795b07e479fe806, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:17.604639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e9672-c779-415a-8d7a-f62b3f44dbb4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:17.739822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c3f08b05024cfcb57238b4f1e55b8a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:17.740450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-151b54bc-c661-4b01-ae1f-d51b32ce232c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c3f08b05024cfcb57238b4f1e55b8a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:17.746864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1049/2077] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:17 2022] DELETE /identity/v3/users/91c3f08b05024cfcb57238b4f1e55b8a => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:17.754490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8fe6-f919-45fb-85db-9691488168f1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.754777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8fe6-f919-45fb-85db-9691488168f1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.755053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8fe6-f919-45fb-85db-9691488168f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.774880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-589f8fe6-f919-45fb-85db-9691488168f1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:17.776076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-589f8fe6-f919-45fb-85db-9691488168f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:17.828632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1029/2078] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:17 2022] PUT /identity/v3/projects/ffcb82d647a143d5be28157af729028c/users/a6a12152836f4134b795b07e479fe806/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:17.843820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0de03d-0da7-451b-a1a9-471d5ca96374 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:17.844124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0de03d-0da7-451b-a1a9-471d5ca96374 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:17.844406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0de03d-0da7-451b-a1a9-471d5ca96374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:17.856145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1050/2079] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:17.866561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f8fe6-f919-45fb-85db-9691488168f1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.869367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-589f8fe6-f919-45fb-85db-9691488168f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:17.876264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3d0de03d-0da7-451b-a1a9-471d5ca96374 None None] MFA Rules not processed for user `a6a12152836f4134b795b07e479fe806`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:17.877520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3d0de03d-0da7-451b-a1a9-471d5ca96374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:17.939727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f8fe6-f919-45fb-85db-9691488168f1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:17.982777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1030/2080] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:17.987510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0de03d-0da7-451b-a1a9-471d5ca96374 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:17.989012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3d0de03d-0da7-451b-a1a9-471d5ca96374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:18.014348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46f44b-92d2-4927-bb11-59edc9ddb735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.016319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:18.016835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46f44b-92d2-4927-bb11-59edc9ddb735 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.017418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46f44b-92d2-4927-bb11-59edc9ddb735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.017837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46f44b-92d2-4927-bb11-59edc9ddb735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.035858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:18.064702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0de03d-0da7-451b-a1a9-471d5ca96374 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.072560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d342-6fd5-47b5-ba86-d29e1f5ecc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.073202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d342-6fd5-47b5-ba86-d29e1f5ecc38 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.073478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d342-6fd5-47b5-ba86-d29e1f5ecc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.073748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d342-6fd5-47b5-ba86-d29e1f5ecc38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.074386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295d342-6fd5-47b5-ba86-d29e1f5ecc38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.076334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295d342-6fd5-47b5-ba86-d29e1f5ecc38 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.080473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46f44b-92d2-4927-bb11-59edc9ddb735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.081902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46f44b-92d2-4927-bb11-59edc9ddb735 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.092523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1051/2081] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:18.199809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1031/2082] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:18.203718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46f44b-92d2-4927-bb11-59edc9ddb735 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.214404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46f44b-92d2-4927-bb11-59edc9ddb735 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.281299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbcdef-684d-4bde-a48c-719540a2ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.281299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbcdef-684d-4bde-a48c-719540a2ec41 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.281299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbcdef-684d-4bde-a48c-719540a2ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.281299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbcdef-684d-4bde-a48c-719540a2ec41 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.284623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbcdef-684d-4bde-a48c-719540a2ec41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.284623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbcdef-684d-4bde-a48c-719540a2ec41 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.406305 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1052/2083] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:18 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:18.410410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d342-6fd5-47b5-ba86-d29e1f5ecc38 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.419392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d342-6fd5-47b5-ba86-d29e1f5ecc38 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.424556 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.425164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.425443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.425718 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.426357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.428058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.442852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1032/2084] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:18.448219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbcdef-684d-4bde-a48c-719540a2ec41 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.458290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbcdef-684d-4bde-a48c-719540a2ec41 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.463219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa02e0d-b80e-40dd-bdcf-6f9926fb1718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.467759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02e0d-b80e-40dd-bdcf-6f9926fb1718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.467759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02e0d-b80e-40dd-bdcf-6f9926fb1718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.467759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02e0d-b80e-40dd-bdcf-6f9926fb1718 admin admin] PATH_INFO: `/v3/projects/e15f7c76f7034a26ab46c37df0b90c3b/users/ab0455b08e3741ae857ac1406baf9d20/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.479723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa02e0d-b80e-40dd-bdcf-6f9926fb1718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15f7c76f7034a26ab46c37df0b90c3b, user_id=ab0455b08e3741ae857ac1406baf9d20, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.482544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa02e0d-b80e-40dd-bdcf-6f9926fb1718 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.530705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.532438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:18.545553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa702a-d0ad-4cf4-b02b-5fa77d01ba72 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.550313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.550939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.551215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.551486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] PATH_INFO: `/v3/projects/93ed315c5ea149f39d79219c71f7dbef` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.552626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ed315c5ea149f39d79219c71f7dbef)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.556044 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.582705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1053/2085] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:18 2022] PUT /identity/v3/projects/e15f7c76f7034a26ab46c37df0b90c3b/users/ab0455b08e3741ae857ac1406baf9d20/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:18.586887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa02e0d-b80e-40dd-bdcf-6f9926fb1718 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.647381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:18.652831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa02e0d-b80e-40dd-bdcf-6f9926fb1718 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.653620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ed315c5ea149f39d79219c71f7dbef', 'request_id': 'req-135c9551-ad19-4f0d-8d28-6d0a3354bc86'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:18.713671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774af68-3fe4-410c-8e0c-c4471c62d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.717733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ed315c5ea149f39d79219c71f7dbef', 'request_id': 'req-135c9551-ad19-4f0d-8d28-6d0a3354bc86'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:18.717878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774af68-3fe4-410c-8e0c-c4471c62d44b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.717878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774af68-3fe4-410c-8e0c-c4471c62d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.717878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774af68-3fe4-410c-8e0c-c4471c62d44b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.717878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774af68-3fe4-410c-8e0c-c4471c62d44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.717878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774af68-3fe4-410c-8e0c-c4471c62d44b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.726857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ed315c5ea149f39d79219c71f7dbef', 'request_id': 'req-135c9551-ad19-4f0d-8d28-6d0a3354bc86'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:18.731289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1054/2086] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:18.735717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774af68-3fe4-410c-8e0c-c4471c62d44b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.745519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] The token cache is being invalidate because project 93ed315c5ea149f39d79219c71f7dbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:18.749433 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:18.749433 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-135c9551-ad19-4f0d-8d28-6d0a3354bc86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:18.749633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774af68-3fe4-410c-8e0c-c4471c62d44b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.752530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1033/2087] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:18 2022] DELETE /identity/v3/projects/93ed315c5ea149f39d79219c71f7dbef => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:18.755403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941ea1-b3db-49d4-b416-9b4d71c50347 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.755653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941ea1-b3db-49d4-b416-9b4d71c50347 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.755924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941ea1-b3db-49d4-b416-9b4d71c50347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.757619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4799-adbf-4d96-a4c0-fef855a5e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.758304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4799-adbf-4d96-a4c0-fef855a5e068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.758594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4799-adbf-4d96-a4c0-fef855a5e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.758876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4799-adbf-4d96-a4c0-fef855a5e068 admin admin] PATH_INFO: `/v3/projects/e15f7c76f7034a26ab46c37df0b90c3b/users/ab0455b08e3741ae857ac1406baf9d20/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.760886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4799-adbf-4d96-a4c0-fef855a5e068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15f7c76f7034a26ab46c37df0b90c3b, user_id=ab0455b08e3741ae857ac1406baf9d20, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.763562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4799-adbf-4d96-a4c0-fef855a5e068 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.774109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1055/2088] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:18 2022] PUT /identity/v3/projects/e15f7c76f7034a26ab46c37df0b90c3b/users/ab0455b08e3741ae857ac1406baf9d20/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:18.781696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-59941ea1-b3db-49d4-b416-9b4d71c50347 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:18.782962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-59941ea1-b3db-49d4-b416-9b4d71c50347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:18.785322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079133e-dc7a-4a9d-b578-53f094526621 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.785711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079133e-dc7a-4a9d-b578-53f094526621 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.785991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079133e-dc7a-4a9d-b578-53f094526621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.816491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d079133e-dc7a-4a9d-b578-53f094526621 None None] MFA Rules not processed for user `ab0455b08e3741ae857ac1406baf9d20`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:18.817736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d079133e-dc7a-4a9d-b578-53f094526621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:18.846977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1034/2089] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:18.857212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78493cee-a416-4ad1-a3af-b5e84f024c32 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.857498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78493cee-a416-4ad1-a3af-b5e84f024c32 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.857777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78493cee-a416-4ad1-a3af-b5e84f024c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.878823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-78493cee-a416-4ad1-a3af-b5e84f024c32 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:18.884878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-78493cee-a416-4ad1-a3af-b5e84f024c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:18.889335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1035/2090] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:18.890205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1056/2091] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:18.893779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78493cee-a416-4ad1-a3af-b5e84f024c32 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.902374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079133e-dc7a-4a9d-b578-53f094526621 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.903737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d079133e-dc7a-4a9d-b578-53f094526621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:18.910894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78493cee-a416-4ad1-a3af-b5e84f024c32 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.914206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.914960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.915250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.915528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.916194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:18.916524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.918166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.935269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1036/2092] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:11:18.939401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:18.952308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34959aa-f641-4244-b504-8710627d52a6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.957975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.972745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.972745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.972745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.972745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:18.972745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:18.982646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079133e-dc7a-4a9d-b578-53f094526621 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:18.988185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50b6d9-d4ef-43f1-9dc0-af080d64bd05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:18.988301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50b6d9-d4ef-43f1-9dc0-af080d64bd05 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:18.988584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50b6d9-d4ef-43f1-9dc0-af080d64bd05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:18.988909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50b6d9-d4ef-43f1-9dc0-af080d64bd05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:18.992810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:19.000425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50b6d9-d4ef-43f1-9dc0-af080d64bd05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:19.005960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50b6d9-d4ef-43f1-9dc0-af080d64bd05 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:19.013129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1057/2093] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:19.062100 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1037/2094] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:18 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:19.067185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50b6d9-d4ef-43f1-9dc0-af080d64bd05 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:19.090860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50b6d9-d4ef-43f1-9dc0-af080d64bd05 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:19.104805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:19.107993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:19.111172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:19.158589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d832d4-b15f-4fe0-9437-a610ca00796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:19.159350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d832d4-b15f-4fe0-9437-a610ca00796f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.159485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d832d4-b15f-4fe0-9437-a610ca00796f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.159751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d832d4-b15f-4fe0-9437-a610ca00796f admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.160379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d832d4-b15f-4fe0-9437-a610ca00796f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:19.162371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d832d4-b15f-4fe0-9437-a610ca00796f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:19.188498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43dc0e-6b87-44f4-9477-115b114fd69f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:19.193885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:19.194637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.195382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.195471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] PATH_INFO: `/v3/users/a6a12152836f4134b795b07e479fe806` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.196677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a12152836f4134b795b07e479fe806)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:19.198626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:19.249225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1058/2095] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:19 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:19.253141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d832d4-b15f-4fe0-9437-a610ca00796f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:19.262692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d832d4-b15f-4fe0-9437-a610ca00796f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:19.267322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79eb81-aa14-4e4b-bd40-f6b2b6a4b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:19.271919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79eb81-aa14-4e4b-bd40-f6b2b6a4b86f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.271919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79eb81-aa14-4e4b-bd40-f6b2b6a4b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.271919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79eb81-aa14-4e4b-bd40-f6b2b6a4b86f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.271919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79eb81-aa14-4e4b-bd40-f6b2b6a4b86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:19.271919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79eb81-aa14-4e4b-bd40-f6b2b6a4b86f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:19.281361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1059/2096] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:19.284997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79eb81-aa14-4e4b-bd40-f6b2b6a4b86f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:19.295364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79eb81-aa14-4e4b-bd40-f6b2b6a4b86f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:19.300142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843b13-4c2f-4017-93d6-6050d78a46a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:19.300767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843b13-4c2f-4017-93d6-6050d78a46a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.301055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843b13-4c2f-4017-93d6-6050d78a46a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.301360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4843b13-4c2f-4017-93d6-6050d78a46a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.302058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4843b13-4c2f-4017-93d6-6050d78a46a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:19.303654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4843b13-4c2f-4017-93d6-6050d78a46a0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:19.315143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1060/2097] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:19.320243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843b13-4c2f-4017-93d6-6050d78a46a0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:19.330434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4843b13-4c2f-4017-93d6-6050d78a46a0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:19.336099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ae914-5d2d-45d6-b589-188b7782840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:19.336784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae914-5d2d-45d6-b589-188b7782840e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.337067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae914-5d2d-45d6-b589-188b7782840e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.337339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae914-5d2d-45d6-b589-188b7782840e admin admin] PATH_INFO: `/v3/projects/8b58d25ae1df4454813a0f76db7e4435/users/578c0a0a8f0544949a4771a651b2ee1e/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.352269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ae914-5d2d-45d6-b589-188b7782840e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b58d25ae1df4454813a0f76db7e4435, user_id=578c0a0a8f0544949a4771a651b2ee1e, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:19.355014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ae914-5d2d-45d6-b589-188b7782840e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:19.397205 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a12152836f4134b795b07e479fe806'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:19.404654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a12152836f4134b795b07e479fe806'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:19.418835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a12152836f4134b795b07e479fe806'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:19.469377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1061/2098] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:19 2022] PUT /identity/v3/projects/8b58d25ae1df4454813a0f76db7e4435/users/578c0a0a8f0544949a4771a651b2ee1e/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:19.474477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be392f-78df-4b13-8863-bc86ab2d421d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.474765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be392f-78df-4b13-8863-bc86ab2d421d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.475042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be392f-78df-4b13-8863-bc86ab2d421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.486284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a12152836f4134b795b07e479fe806'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:19.487321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-334ab82d-7f19-4271-bde8-1933c09169f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a12152836f4134b795b07e479fe806'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:19.496469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1038/2099] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:19 2022] DELETE /identity/v3/users/a6a12152836f4134b795b07e479fe806 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:19.499541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-30be392f-78df-4b13-8863-bc86ab2d421d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:19.500667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedb4ab-bee4-41dd-bd7f-9dba343aee0f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.500971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedb4ab-bee4-41dd-bd7f-9dba343aee0f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.501264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedb4ab-bee4-41dd-bd7f-9dba343aee0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.501541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-30be392f-78df-4b13-8863-bc86ab2d421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:19.523347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5dedb4ab-bee4-41dd-bd7f-9dba343aee0f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:19.524765 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5dedb4ab-bee4-41dd-bd7f-9dba343aee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:19.581097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1062/2100] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:19.593090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be392f-78df-4b13-8863-bc86ab2d421d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:19.595779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-30be392f-78df-4b13-8863-bc86ab2d421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:19.600401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1039/2101] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:19.612050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedb4ab-bee4-41dd-bd7f-9dba343aee0f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:19.613549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5dedb4ab-bee4-41dd-bd7f-9dba343aee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:19.634566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:19.665714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be392f-78df-4b13-8863-bc86ab2d421d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:19.669758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:19.670455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.670755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.671030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.681212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedb4ab-bee4-41dd-bd7f-9dba343aee0f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:19.682261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:19.683831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:19.686692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:19.687300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:19.687621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:19.687896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:19.689556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:19.695162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1063/2102] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:19.698674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:19.700096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:19.709975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1040/2103] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:19.997835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:19.999533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:20.013592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baba6ca-9d20-44c3-ab5a-eaf7ce2b170e service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:20.019684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:20.019684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:20.019684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:20.024098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] PATH_INFO: `/v3/users/076efce4d0b849848d325d9d49a1cdb9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:20.024098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=076efce4d0b849848d325d9d49a1cdb9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:20.024098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:20.231796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:20.233362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:20.250224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01596e-3caf-4000-8ed1-0469205bf778 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:20.256299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:20.256977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:20.257852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:20.258126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] PATH_INFO: `/v3/projects/ffcb82d647a143d5be28157af729028c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:20.259392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcb82d647a143d5be28157af729028c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:20.261340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:20.300389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076efce4d0b849848d325d9d49a1cdb9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.317333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076efce4d0b849848d325d9d49a1cdb9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.325783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076efce4d0b849848d325d9d49a1cdb9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.425248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076efce4d0b849848d325d9d49a1cdb9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.426337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16c234b-0344-4e05-aa4a-56e8a7a20468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076efce4d0b849848d325d9d49a1cdb9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.437183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1064/2104] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:19 2022] DELETE /identity/v3/users/076efce4d0b849848d325d9d49a1cdb9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:20.449767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55341b-c22e-4658-87a7-11f93f1bc592 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:20.449767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55341b-c22e-4658-87a7-11f93f1bc592 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:20.449767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55341b-c22e-4658-87a7-11f93f1bc592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:20.451193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcb82d647a143d5be28157af729028c', 'request_id': 'req-cb75d22d-69dd-444f-b74c-e786123d5be9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.479963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5f55341b-c22e-4658-87a7-11f93f1bc592 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:20.481310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5f55341b-c22e-4658-87a7-11f93f1bc592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:20.551490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1065/2105] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:20.563304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55341b-c22e-4658-87a7-11f93f1bc592 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:20.564739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5f55341b-c22e-4658-87a7-11f93f1bc592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:20.598286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcb82d647a143d5be28157af729028c', 'request_id': 'req-cb75d22d-69dd-444f-b74c-e786123d5be9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.608416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcb82d647a143d5be28157af729028c', 'request_id': 'req-cb75d22d-69dd-444f-b74c-e786123d5be9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.628274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] The token cache is being invalidate because project ffcb82d647a143d5be28157af729028c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:20.628751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.629563 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.630752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55341b-c22e-4658-87a7-11f93f1bc592 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:20.631834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1041/2106] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:20 2022] DELETE /identity/v3/projects/ffcb82d647a143d5be28157af729028c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:20.636314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:20.636670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:20.637693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:20.637693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:20.637893 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:20.637972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:20.639909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:20.655052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:20.657397 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:20.671740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1066/2107] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:20.716768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75d22d-69dd-444f-b74c-e786123d5be9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:20.721962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:20.726846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:20.726846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:20.726846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] PATH_INFO: `/v3/users/ab0455b08e3741ae857ac1406baf9d20` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:20.726846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0455b08e3741ae857ac1406baf9d20)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:20.727549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:20.945501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:20.948840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0455b08e3741ae857ac1406baf9d20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.956421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0455b08e3741ae857ac1406baf9d20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:20.976006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0455b08e3741ae857ac1406baf9d20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.071933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0455b08e3741ae857ac1406baf9d20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.072626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0455b08e3741ae857ac1406baf9d20'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.082311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1042/2108] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:20 2022] DELETE /identity/v3/users/ab0455b08e3741ae857ac1406baf9d20 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:21.182172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:21.187181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:21.215345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7f314-5d47-4a68-8622-174cded4d7fe service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:21.232896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:21.282673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:21.283309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:21.283592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:21.283869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] PATH_INFO: `/v3/projects/29ecf911822248738aef833757aec2e1` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:21.285036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ecf911822248738aef833757aec2e1)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:21.287000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:21.435167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ecf911822248738aef833757aec2e1', 'request_id': 'req-1377667e-1617-4bd3-9cb7-f15d5da3d824'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.441779 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ecf911822248738aef833757aec2e1', 'request_id': 'req-1377667e-1617-4bd3-9cb7-f15d5da3d824'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.447863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ecf911822248738aef833757aec2e1', 'request_id': 'req-1377667e-1617-4bd3-9cb7-f15d5da3d824'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.532659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] The token cache is being invalidate because project 29ecf911822248738aef833757aec2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:21.532971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.533642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.535153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1067/2109] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:21 2022] DELETE /identity/v3/projects/29ecf911822248738aef833757aec2e1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:21.540665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:21.542187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:21.556139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74594ccd-0564-41cd-91a2-8574671612d8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:21.616800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:21.617817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:21.618098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:21.618684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] PATH_INFO: `/v3/users/a59459f47f5c4553b220595b1a66d7dd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:21.619943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59459f47f5c4553b220595b1a66d7dd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:21.621951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:21.830875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:21.832510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:21.855652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377667e-1617-4bd3-9cb7-f15d5da3d824 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:21.867648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59459f47f5c4553b220595b1a66d7dd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.871316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:21.872055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:21.872260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:21.872569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] PATH_INFO: `/v3/projects/e15f7c76f7034a26ab46c37df0b90c3b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:21.877569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59459f47f5c4553b220595b1a66d7dd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.879054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15f7c76f7034a26ab46c37df0b90c3b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:21.881091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:21.893243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59459f47f5c4553b220595b1a66d7dd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.957349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59459f47f5c4553b220595b1a66d7dd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.958232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-76d6c657-acf6-418d-92a2-c74f1ce48fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59459f47f5c4553b220595b1a66d7dd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:21.967466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1043/2110] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:21 2022] DELETE /identity/v3/users/a59459f47f5c4553b220595b1a66d7dd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:22.016599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15f7c76f7034a26ab46c37df0b90c3b', 'request_id': 'req-3034d887-1b56-4cb4-bdcb-cfdca5e61913'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.023181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15f7c76f7034a26ab46c37df0b90c3b', 'request_id': 'req-3034d887-1b56-4cb4-bdcb-cfdca5e61913'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.030247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15f7c76f7034a26ab46c37df0b90c3b', 'request_id': 'req-3034d887-1b56-4cb4-bdcb-cfdca5e61913'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.102972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] The token cache is being invalidate because project e15f7c76f7034a26ab46c37df0b90c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:22.103349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.104287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3034d887-1b56-4cb4-bdcb-cfdca5e61913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.108951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1068/2111] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:21 2022] DELETE /identity/v3/projects/e15f7c76f7034a26ab46c37df0b90c3b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:22.114747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be2c2f-082e-4df0-83fc-bf1d264e1d4c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.115038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be2c2f-082e-4df0-83fc-bf1d264e1d4c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.115316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be2c2f-082e-4df0-83fc-bf1d264e1d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.144526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-76be2c2f-082e-4df0-83fc-bf1d264e1d4c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:22.145774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-76be2c2f-082e-4df0-83fc-bf1d264e1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:22.194833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:22.300791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1044/2112] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:22.310225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743d43-641c-4f59-b6b7-130fc7d09f70 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.310755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743d43-641c-4f59-b6b7-130fc7d09f70 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.311312 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743d43-641c-4f59-b6b7-130fc7d09f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.333602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ad743d43-641c-4f59-b6b7-130fc7d09f70 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:22.334843 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ad743d43-641c-4f59-b6b7-130fc7d09f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:22.354521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1069/2113] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:22.358630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be2c2f-082e-4df0-83fc-bf1d264e1d4c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.371523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be2c2f-082e-4df0-83fc-bf1d264e1d4c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:22.381864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:22.387879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.387879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.387879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.387879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:22.387879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:22.387879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:22.405396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1045/2114] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:11:22.410747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad743d43-641c-4f59-b6b7-130fc7d09f70 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.461501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad743d43-641c-4f59-b6b7-130fc7d09f70 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:22.481533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eddac0-49fa-4ce7-8542-d5b29f02f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:22.482172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eddac0-49fa-4ce7-8542-d5b29f02f641 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.482646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eddac0-49fa-4ce7-8542-d5b29f02f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.483084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eddac0-49fa-4ce7-8542-d5b29f02f641 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.484047 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eddac0-49fa-4ce7-8542-d5b29f02f641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:22.486239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eddac0-49fa-4ce7-8542-d5b29f02f641 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:22.524677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.529652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:22.546112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe3fcd-a156-405f-a5e3-2c9ac35fe82a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:22.552281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:22.553110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.553498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.553960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] PATH_INFO: `/v3/projects/3716e2ea915f424c8e09a13a0b144af5` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.555304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3716e2ea915f424c8e09a13a0b144af5)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:22.557947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:22.568259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:22.577356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1070/2115] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:22 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:22.581457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eddac0-49fa-4ce7-8542-d5b29f02f641 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.665350 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eddac0-49fa-4ce7-8542-d5b29f02f641 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:22.670201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049856d-7c2f-421e-8de1-37e44cc2977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:22.670811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049856d-7c2f-421e-8de1-37e44cc2977f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.671091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049856d-7c2f-421e-8de1-37e44cc2977f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.671364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049856d-7c2f-421e-8de1-37e44cc2977f admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.672020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049856d-7c2f-421e-8de1-37e44cc2977f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:22.673986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049856d-7c2f-421e-8de1-37e44cc2977f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:22.712605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3716e2ea915f424c8e09a13a0b144af5', 'request_id': 'req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.778346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1071/2116] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:22 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:22.779433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049856d-7c2f-421e-8de1-37e44cc2977f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.790634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049856d-7c2f-421e-8de1-37e44cc2977f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:22.837012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3716e2ea915f424c8e09a13a0b144af5', 'request_id': 'req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.842773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3716e2ea915f424c8e09a13a0b144af5', 'request_id': 'req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.856529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:22.857139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.857279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] The token cache is being invalidate because project 3716e2ea915f424c8e09a13a0b144af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:22.857426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.857706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.857825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.858362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:22.858629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49f44ad3-9dc6-46fe-9231-f2fb651d7f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:22.860011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:22.860819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1046/2117] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:22 2022] DELETE /identity/v3/projects/3716e2ea915f424c8e09a13a0b144af5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:22.865860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb1de-e9a1-49c4-9e79-543ed47d3a4f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.866247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb1de-e9a1-49c4-9e79-543ed47d3a4f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.867668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb1de-e9a1-49c4-9e79-543ed47d3a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.875222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1072/2118] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:22.876321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.878286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:22.894427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f707f-2f99-43ec-9974-8032cad6beb0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:22.894734 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-276cb1de-e9a1-49c4-9e79-543ed47d3a4f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:22.896058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-276cb1de-e9a1-49c4-9e79-543ed47d3a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:22.900393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e806c-5b9f-4236-b3f4-d01036ac6a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:22.901203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e806c-5b9f-4236-b3f4-d01036ac6a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.901498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e806c-5b9f-4236-b3f4-d01036ac6a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.902638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e806c-5b9f-4236-b3f4-d01036ac6a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.902638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e806c-5b9f-4236-b3f4-d01036ac6a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:22.904027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e806c-5b9f-4236-b3f4-d01036ac6a69 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:22.906635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1047/2119] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:22.914623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200169-bad3-4d05-b83d-97edefd2d4a4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.915007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200169-bad3-4d05-b83d-97edefd2d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.915360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200169-bad3-4d05-b83d-97edefd2d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.922198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1073/2120] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:22.932352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e806c-5b9f-4236-b3f4-d01036ac6a69 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.936705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-01200169-bad3-4d05-b83d-97edefd2d4a4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:22.938005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-01200169-bad3-4d05-b83d-97edefd2d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:22.948087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1048/2121] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:22.951936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200169-bad3-4d05-b83d-97edefd2d4a4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.958233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e806c-5b9f-4236-b3f4-d01036ac6a69 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:22.962799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200169-bad3-4d05-b83d-97edefd2d4a4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:22.966252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f660251-4c78-4122-8747-30cbd0d624df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:22.967572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660251-4c78-4122-8747-30cbd0d624df admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.967867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660251-4c78-4122-8747-30cbd0d624df admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.968151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660251-4c78-4122-8747-30cbd0d624df admin admin] PATH_INFO: `/v3/projects/1030c1d3e49b4feeb03c5e70b4af6790/users/c10de65c95de4e7b9f23d36142e45d29/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.968261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:22.968924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:22.969207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:22.969571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:22.970308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:22.970613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:22.973003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:22.990855 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1049/2122] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:11:22.995090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:22.996879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f660251-4c78-4122-8747-30cbd0d624df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1030c1d3e49b4feeb03c5e70b4af6790, user_id=c10de65c95de4e7b9f23d36142e45d29, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.000586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f660251-4c78-4122-8747-30cbd0d624df admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.007527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844f75-800d-4b9c-be8d-89c1e644cd9f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.012300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94cfa4-19ff-4804-a9fe-0ea8a4f40c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.012953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94cfa4-19ff-4804-a9fe-0ea8a4f40c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.013228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94cfa4-19ff-4804-a9fe-0ea8a4f40c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.013492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94cfa4-19ff-4804-a9fe-0ea8a4f40c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.014329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94cfa4-19ff-4804-a9fe-0ea8a4f40c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.016290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94cfa4-19ff-4804-a9fe-0ea8a4f40c29 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.129703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1074/2123] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:22 2022] PUT /identity/v3/projects/1030c1d3e49b4feeb03c5e70b4af6790/users/c10de65c95de4e7b9f23d36142e45d29/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:23.135782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1050/2124] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:22 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:23.138810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f660251-4c78-4122-8747-30cbd0d624df admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.140875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b9e97-7ba5-47e6-9d4a-7f9edf372e65 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.141173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b9e97-7ba5-47e6-9d4a-7f9edf372e65 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.141441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b9e97-7ba5-47e6-9d4a-7f9edf372e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.177941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0a5b9e97-7ba5-47e6-9d4a-7f9edf372e65 None None] MFA Rules not processed for user `c10de65c95de4e7b9f23d36142e45d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:23.179218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0a5b9e97-7ba5-47e6-9d4a-7f9edf372e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:23.233872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f660251-4c78-4122-8747-30cbd0d624df admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.261444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1051/2125] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:23.269521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b9e97-7ba5-47e6-9d4a-7f9edf372e65 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.329192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2187b9-686d-42ee-8fdf-f646ebcb6317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.329851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2187b9-686d-42ee-8fdf-f646ebcb6317 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.330188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2187b9-686d-42ee-8fdf-f646ebcb6317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.330461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2187b9-686d-42ee-8fdf-f646ebcb6317 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.331284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2187b9-686d-42ee-8fdf-f646ebcb6317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.336418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2187b9-686d-42ee-8fdf-f646ebcb6317 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.339138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:23.356107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b9e97-7ba5-47e6-9d4a-7f9edf372e65 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.362264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fe1a2-3f8b-4865-973d-30199938ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.362965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fe1a2-3f8b-4865-973d-30199938ba98 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.363235 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fe1a2-3f8b-4865-973d-30199938ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.363517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fe1a2-3f8b-4865-973d-30199938ba98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.364191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fe1a2-3f8b-4865-973d-30199938ba98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.366285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fe1a2-3f8b-4865-973d-30199938ba98 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.424222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1075/2126] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:23 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:23.428107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2187b9-686d-42ee-8fdf-f646ebcb6317 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.440838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2187b9-686d-42ee-8fdf-f646ebcb6317 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.447024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51deeb80-d77d-427d-8168-c40a1645b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.447898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeb80-d77d-427d-8168-c40a1645b79c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.448380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeb80-d77d-427d-8168-c40a1645b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.448777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deeb80-d77d-427d-8168-c40a1645b79c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.449588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51deeb80-d77d-427d-8168-c40a1645b79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.452627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51deeb80-d77d-427d-8168-c40a1645b79c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.460432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1052/2127] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:23 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:23.464093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fe1a2-3f8b-4865-973d-30199938ba98 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.469960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1076/2128] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:23.473733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51deeb80-d77d-427d-8168-c40a1645b79c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.483253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:23.489451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51deeb80-d77d-427d-8168-c40a1645b79c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.544170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fe1a2-3f8b-4865-973d-30199938ba98 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.550098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c29bc-530f-4bda-b220-96ef88b1fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.552197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c29bc-530f-4bda-b220-96ef88b1fdea admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.555514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c29bc-530f-4bda-b220-96ef88b1fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.555514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c29bc-530f-4bda-b220-96ef88b1fdea admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.556309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c29bc-530f-4bda-b220-96ef88b1fdea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.559975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c29bc-530f-4bda-b220-96ef88b1fdea admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.564949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720537c-4a26-432b-bfca-a040c4283562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.565705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720537c-4a26-432b-bfca-a040c4283562 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.566101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720537c-4a26-432b-bfca-a040c4283562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.566555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720537c-4a26-432b-bfca-a040c4283562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.567539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720537c-4a26-432b-bfca-a040c4283562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.569323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720537c-4a26-432b-bfca-a040c4283562 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.592304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1077/2129] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:23.601693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720537c-4a26-432b-bfca-a040c4283562 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.608297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720537c-4a26-432b-bfca-a040c4283562 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.614085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81532ef-709b-4117-8c8d-2cf200143c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.614819 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81532ef-709b-4117-8c8d-2cf200143c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.615059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81532ef-709b-4117-8c8d-2cf200143c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.615483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81532ef-709b-4117-8c8d-2cf200143c53 admin admin] PATH_INFO: `/v3/projects/f1bbde55bafa42108676212642d7d3bd/users/0b4ee04a6c6d42fd9bc97d5e356d4a0a/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.634168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81532ef-709b-4117-8c8d-2cf200143c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bbde55bafa42108676212642d7d3bd, user_id=0b4ee04a6c6d42fd9bc97d5e356d4a0a, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.637149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81532ef-709b-4117-8c8d-2cf200143c53 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.701996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1053/2130] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:23 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:23.706190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c29bc-530f-4bda-b220-96ef88b1fdea admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.718583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c29bc-530f-4bda-b220-96ef88b1fdea admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.726743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb09515-fa72-4e41-b6a0-38e0fe4e9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.727767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09515-fa72-4e41-b6a0-38e0fe4e9423 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.728214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09515-fa72-4e41-b6a0-38e0fe4e9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.732335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09515-fa72-4e41-b6a0-38e0fe4e9423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.732335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb09515-fa72-4e41-b6a0-38e0fe4e9423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.732568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1078/2131] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:23 2022] PUT /identity/v3/projects/f1bbde55bafa42108676212642d7d3bd/users/0b4ee04a6c6d42fd9bc97d5e356d4a0a/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:23.732648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb09515-fa72-4e41-b6a0-38e0fe4e9423 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.736227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa8b98-31e7-4630-a320-fb3ed6716c81 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.737751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa8b98-31e7-4630-a320-fb3ed6716c81 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.740590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa8b98-31e7-4630-a320-fb3ed6716c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.747371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1054/2132] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:23.755013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb09515-fa72-4e41-b6a0-38e0fe4e9423 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.767421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb09515-fa72-4e41-b6a0-38e0fe4e9423 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:23.785939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e8aa8b98-31e7-4630-a320-fb3ed6716c81 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:23.787447 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e8aa8b98-31e7-4630-a320-fb3ed6716c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:23.906094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1079/2133] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:23.906301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d16d3-cb30-4416-87b1-634f0d1d56e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:23.906301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d16d3-cb30-4416-87b1-634f0d1d56e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:23.906301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d16d3-cb30-4416-87b1-634f0d1d56e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:23.906301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d16d3-cb30-4416-87b1-634f0d1d56e3 admin admin] PATH_INFO: `/v3/projects/4e09e4a7c5aa4d4aa4d9b2dc2882d501/users/223063515abd4d2a8895a627ca454b42/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:23.912328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:23.916529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa8b98-31e7-4630-a320-fb3ed6716c81 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:23.918147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e8aa8b98-31e7-4630-a320-fb3ed6716c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:23.927650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d16d3-cb30-4416-87b1-634f0d1d56e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e09e4a7c5aa4d4aa4d9b2dc2882d501, user_id=223063515abd4d2a8895a627ca454b42, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:23.930698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d16d3-cb30-4416-87b1-634f0d1d56e3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:23.941131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:23.982850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa8b98-31e7-4630-a320-fb3ed6716c81 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:24.008838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1055/2134] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:23 2022] PUT /identity/v3/projects/4e09e4a7c5aa4d4aa4d9b2dc2882d501/users/223063515abd4d2a8895a627ca454b42/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:24.008838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d16d3-cb30-4416-87b1-634f0d1d56e3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:24.080239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b70667-c62a-4607-971e-2c2f5184ca08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:24.081101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b70667-c62a-4607-971e-2c2f5184ca08 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:24.081488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b70667-c62a-4607-971e-2c2f5184ca08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:24.081833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b70667-c62a-4607-971e-2c2f5184ca08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:24.088329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d16d3-cb30-4416-87b1-634f0d1d56e3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:24.093822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331e610-2f55-4f64-9b84-9031d77bd2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:24.094414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b70667-c62a-4607-971e-2c2f5184ca08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:24.095917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331e610-2f55-4f64-9b84-9031d77bd2de admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:24.096039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b70667-c62a-4607-971e-2c2f5184ca08 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:24.096692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331e610-2f55-4f64-9b84-9031d77bd2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:24.097200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331e610-2f55-4f64-9b84-9031d77bd2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:24.098680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331e610-2f55-4f64-9b84-9031d77bd2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:24.101622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331e610-2f55-4f64-9b84-9031d77bd2de admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:24.113355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1080/2135] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:24.118120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1056/2136] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:24.122018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b70667-c62a-4607-971e-2c2f5184ca08 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:24.139197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b70667-c62a-4607-971e-2c2f5184ca08 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:24.144302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:24.145108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:24.145508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:24.145867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] PATH_INFO: `/v3/projects/4e09e4a7c5aa4d4aa4d9b2dc2882d501/users/223063515abd4d2a8895a627ca454b42/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:24.148214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e09e4a7c5aa4d4aa4d9b2dc2882d501, user_id=223063515abd4d2a8895a627ca454b42, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:24.151164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:24.174264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1081/2137] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:24 2022] PUT /identity/v3/projects/4e09e4a7c5aa4d4aa4d9b2dc2882d501/users/223063515abd4d2a8895a627ca454b42/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:24.180714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388633eb-4cdb-4802-b186-8a4a1c8ae2c9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:24.181349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388633eb-4cdb-4802-b186-8a4a1c8ae2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:24.181808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388633eb-4cdb-4802-b186-8a4a1c8ae2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:24.221466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-388633eb-4cdb-4802-b186-8a4a1c8ae2c9 None None] MFA Rules not processed for user `223063515abd4d2a8895a627ca454b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:24.223136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-388633eb-4cdb-4802-b186-8a4a1c8ae2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:24.319461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1057/2138] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:24.326961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:24.329262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:24.438274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4e74-78df-420a-995a-2b5ea81ee3d0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:24.442636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aabaee-7814-4c54-ab6f-cc77c4a7f728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:24.443949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabaee-7814-4c54-ab6f-cc77c4a7f728 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:24.444934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabaee-7814-4c54-ab6f-cc77c4a7f728 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:24.445450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabaee-7814-4c54-ab6f-cc77c4a7f728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:24.459814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aabaee-7814-4c54-ab6f-cc77c4a7f728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:24.462862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aabaee-7814-4c54-ab6f-cc77c4a7f728 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:24.478491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1082/2139] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:24.593973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388633eb-4cdb-4802-b186-8a4a1c8ae2c9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:24.611881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388633eb-4cdb-4802-b186-8a4a1c8ae2c9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:24.616999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba27f1f-4079-4959-9897-dffde76d08ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:24.618352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba27f1f-4079-4959-9897-dffde76d08ed service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:24.618847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba27f1f-4079-4959-9897-dffde76d08ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:24.619426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba27f1f-4079-4959-9897-dffde76d08ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:24.746527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba27f1f-4079-4959-9897-dffde76d08ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:24.750013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba27f1f-4079-4959-9897-dffde76d08ed service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:24.782098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:24.801399 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1058/2140] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:25.733881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ad8b6-1c28-45bd-8ff5-903d37975c0a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:25.734399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ad8b6-1c28-45bd-8ff5-903d37975c0a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:25.734952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ad8b6-1c28-45bd-8ff5-903d37975c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:25.813536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b08ad8b6-1c28-45bd-8ff5-903d37975c0a None None] MFA Rules not processed for user `0b4ee04a6c6d42fd9bc97d5e356d4a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:25.815208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b08ad8b6-1c28-45bd-8ff5-903d37975c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:25.873967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:25.955396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1083/2141] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:25.970057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba27f1f-4079-4959-9897-dffde76d08ed service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:25.979261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba27f1f-4079-4959-9897-dffde76d08ed service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:25.983603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:25.984236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:25.984546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:25.984823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:25.994710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:26.000803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:26.006192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1059/2142] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:27.295801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f57a4-16b7-4397-8999-665208d13bbe None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:27.295801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f57a4-16b7-4397-8999-665208d13bbe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:27.295801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f57a4-16b7-4397-8999-665208d13bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:27.326467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6c3f57a4-16b7-4397-8999-665208d13bbe None None] MFA Rules not processed for user `578c0a0a8f0544949a4771a651b2ee1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:27.327790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6c3f57a4-16b7-4397-8999-665208d13bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:27.398830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1084/2143] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:27.403476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:27.404915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:27.497693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4503-1e8c-48a3-affc-4828a72ca3bc service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:27.503582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6aded-8f8f-4863-adc3-75d7a5317490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:27.504837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6aded-8f8f-4863-adc3-75d7a5317490 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:27.505133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6aded-8f8f-4863-adc3-75d7a5317490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:27.505470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6aded-8f8f-4863-adc3-75d7a5317490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:27.506138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6aded-8f8f-4863-adc3-75d7a5317490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:27.509870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6aded-8f8f-4863-adc3-75d7a5317490 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:27.641970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1060/2144] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:27 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:27.644791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f57a4-16b7-4397-8999-665208d13bbe None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:27.660342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f57a4-16b7-4397-8999-665208d13bbe None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:27.727534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f61d5-322d-40e5-8fd7-e273020cf614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:27.728172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f61d5-322d-40e5-8fd7-e273020cf614 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:27.728454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f61d5-322d-40e5-8fd7-e273020cf614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:27.728870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f61d5-322d-40e5-8fd7-e273020cf614 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:27.729503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f61d5-322d-40e5-8fd7-e273020cf614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:27.731412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f61d5-322d-40e5-8fd7-e273020cf614 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:27.850555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1085/2145] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:27 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:27.855085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6aded-8f8f-4863-adc3-75d7a5317490 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:27.867697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6aded-8f8f-4863-adc3-75d7a5317490 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:27.873889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ca0f-e157-44be-bbee-91c1d951e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:27.880528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ca0f-e157-44be-bbee-91c1d951e414 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:27.880528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ca0f-e157-44be-bbee-91c1d951e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:27.880528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ca0f-e157-44be-bbee-91c1d951e414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:27.880528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ca0f-e157-44be-bbee-91c1d951e414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:27.880528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ca0f-e157-44be-bbee-91c1d951e414 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:27.891019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1061/2146] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:27.896034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f61d5-322d-40e5-8fd7-e273020cf614 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:27.906510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f61d5-322d-40e5-8fd7-e273020cf614 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:27.911354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916580-f929-4b3a-a0ca-a43aca2d2bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:27.912011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916580-f929-4b3a-a0ca-a43aca2d2bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:27.912291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916580-f929-4b3a-a0ca-a43aca2d2bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:27.912594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916580-f929-4b3a-a0ca-a43aca2d2bf7 admin admin] PATH_INFO: `/v3/projects/bce3cdff32bf4ce0a936f7345fc731b1/users/3fed5d075e284f428bee68330ff204b1/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:27.931205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916580-f929-4b3a-a0ca-a43aca2d2bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce3cdff32bf4ce0a936f7345fc731b1, user_id=3fed5d075e284f428bee68330ff204b1, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:27.934778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916580-f929-4b3a-a0ca-a43aca2d2bf7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:28.009343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1086/2147] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:27 2022] PUT /identity/v3/projects/bce3cdff32bf4ce0a936f7345fc731b1/users/3fed5d075e284f428bee68330ff204b1/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:28.013392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ca0f-e157-44be-bbee-91c1d951e414 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:28.024379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ca0f-e157-44be-bbee-91c1d951e414 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:28.096684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c1a5c-ce6c-4d95-bf37-79d7d57f14f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:28.097344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1a5c-ce6c-4d95-bf37-79d7d57f14f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:28.097622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1a5c-ce6c-4d95-bf37-79d7d57f14f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:28.097890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1a5c-ce6c-4d95-bf37-79d7d57f14f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:28.098565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c1a5c-ce6c-4d95-bf37-79d7d57f14f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:28.100422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c1a5c-ce6c-4d95-bf37-79d7d57f14f1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:28.110659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1062/2148] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:28.114891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916580-f929-4b3a-a0ca-a43aca2d2bf7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:28.126201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916580-f929-4b3a-a0ca-a43aca2d2bf7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:28.130808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b92b-a9ad-4b13-ad9d-0f1c5fbfc09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:28.131461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b92b-a9ad-4b13-ad9d-0f1c5fbfc09a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:28.131767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b92b-a9ad-4b13-ad9d-0f1c5fbfc09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:28.132096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b92b-a9ad-4b13-ad9d-0f1c5fbfc09a admin admin] PATH_INFO: `/v3/projects/bce3cdff32bf4ce0a936f7345fc731b1/users/3fed5d075e284f428bee68330ff204b1/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:28.135040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b92b-a9ad-4b13-ad9d-0f1c5fbfc09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce3cdff32bf4ce0a936f7345fc731b1, user_id=3fed5d075e284f428bee68330ff204b1, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:28.137757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b92b-a9ad-4b13-ad9d-0f1c5fbfc09a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:28.149013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1087/2149] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:28 2022] PUT /identity/v3/projects/bce3cdff32bf4ce0a936f7345fc731b1/users/3fed5d075e284f428bee68330ff204b1/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:29.135834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c523362-ca9e-453d-bcdf-4f10e1fbd545 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:29.135834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c523362-ca9e-453d-bcdf-4f10e1fbd545 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:29.135834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c523362-ca9e-453d-bcdf-4f10e1fbd545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:29.153725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3c523362-ca9e-453d-bcdf-4f10e1fbd545 None None] MFA Rules not processed for user `0b4ee04a6c6d42fd9bc97d5e356d4a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:29.154941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3c523362-ca9e-453d-bcdf-4f10e1fbd545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:29.214115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:29.229955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1063/2150] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:29.310085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b92b-a9ad-4b13-ad9d-0f1c5fbfc09a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:29.321741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:29.388526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b92b-a9ad-4b13-ad9d-0f1c5fbfc09a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:29.394798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:29.395461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:29.395814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:29.396228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] PATH_INFO: `/v3/users/c10de65c95de4e7b9f23d36142e45d29` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:29.397479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10de65c95de4e7b9f23d36142e45d29)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:29.400632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:29.695765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10de65c95de4e7b9f23d36142e45d29'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:29.713561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10de65c95de4e7b9f23d36142e45d29'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:29.722963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10de65c95de4e7b9f23d36142e45d29'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:29.791770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10de65c95de4e7b9f23d36142e45d29'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:29.793163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10de65c95de4e7b9f23d36142e45d29'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:29.800341 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1088/2151] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:29 2022] DELETE /identity/v3/users/c10de65c95de4e7b9f23d36142e45d29 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:29.806033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0c6d-b530-40b3-88f7-a14a047faac9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:29.806408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0c6d-b530-40b3-88f7-a14a047faac9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:29.806767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0c6d-b530-40b3-88f7-a14a047faac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:29.833791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-24cf0c6d-b530-40b3-88f7-a14a047faac9 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:29.835153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-24cf0c6d-b530-40b3-88f7-a14a047faac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:29.947432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1064/2152] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:29.957134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:29.958709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:30.023428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d58715-66e0-4381-bbee-77da36777061 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:30.027356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0c267-bbc4-4553-b17f-25fba31f0b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:30.028040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c267-bbc4-4553-b17f-25fba31f0b98 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:30.028388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c267-bbc4-4553-b17f-25fba31f0b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:30.028795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c267-bbc4-4553-b17f-25fba31f0b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:30.038973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0c267-bbc4-4553-b17f-25fba31f0b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:30.041327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0c267-bbc4-4553-b17f-25fba31f0b98 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:30.052523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1089/2153] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:30.686084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0c6d-b530-40b3-88f7-a14a047faac9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:30.687667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-24cf0c6d-b530-40b3-88f7-a14a047faac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:30.708415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0c6d-b530-40b3-88f7-a14a047faac9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:30.715047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:30.717451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:30.717451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:30.717451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] PATH_INFO: `/v3/projects/1030c1d3e49b4feeb03c5e70b4af6790` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:30.718987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1030c1d3e49b4feeb03c5e70b4af6790)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:30.721480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:30.979623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1030c1d3e49b4feeb03c5e70b4af6790', 'request_id': 'req-85c8a5d5-2009-411e-b3a3-666cb87e4f17'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.077295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1030c1d3e49b4feeb03c5e70b4af6790', 'request_id': 'req-85c8a5d5-2009-411e-b3a3-666cb87e4f17'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.100245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1030c1d3e49b4feeb03c5e70b4af6790', 'request_id': 'req-85c8a5d5-2009-411e-b3a3-666cb87e4f17'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.125544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] The token cache is being invalidate because project 1030c1d3e49b4feeb03c5e70b4af6790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:31.125849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.127056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.130299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1065/2154] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:30 2022] DELETE /identity/v3/projects/1030c1d3e49b4feeb03c5e70b4af6790 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:31.135144 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0c267-bbc4-4553-b17f-25fba31f0b98 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:31.148675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0c267-bbc4-4553-b17f-25fba31f0b98 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:31.206604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:31.247002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:31.247760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:31.248040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:31.248542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] PATH_INFO: `/v3/users/223063515abd4d2a8895a627ca454b42` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:31.249895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223063515abd4d2a8895a627ca454b42)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:31.253929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:31.544712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223063515abd4d2a8895a627ca454b42'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.577121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223063515abd4d2a8895a627ca454b42'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.591131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223063515abd4d2a8895a627ca454b42'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.664129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223063515abd4d2a8895a627ca454b42'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.665142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c7105d2b-aa98-4a99-9bbf-ec24ca173d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223063515abd4d2a8895a627ca454b42'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:31.685540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1090/2155] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:31 2022] DELETE /identity/v3/users/223063515abd4d2a8895a627ca454b42 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:32.821202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:32.821877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:32.859371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a5d5-2009-411e-b3a3-666cb87e4f17 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:33.019692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:33.025303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:33.025303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:33.025303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] PATH_INFO: `/v3/projects/4e09e4a7c5aa4d4aa4d9b2dc2882d501` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:33.029314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e09e4a7c5aa4d4aa4d9b2dc2882d501)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:33.031708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:33.198112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:33.262426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e09e4a7c5aa4d4aa4d9b2dc2882d501', 'request_id': 'req-444f997c-6e70-4237-9938-9a8326b53525'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:33.374909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e09e4a7c5aa4d4aa4d9b2dc2882d501', 'request_id': 'req-444f997c-6e70-4237-9938-9a8326b53525'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:33.387428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e09e4a7c5aa4d4aa4d9b2dc2882d501', 'request_id': 'req-444f997c-6e70-4237-9938-9a8326b53525'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:33.408226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] The token cache is being invalidate because project 4e09e4a7c5aa4d4aa4d9b2dc2882d501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:33.409288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:33.410331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-444f997c-6e70-4237-9938-9a8326b53525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:33.412729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1066/2156] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:32 2022] DELETE /identity/v3/projects/4e09e4a7c5aa4d4aa4d9b2dc2882d501 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:33.418258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730949c2-ebb1-4160-b998-b5af33bbc820 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:33.419105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730949c2-ebb1-4160-b998-b5af33bbc820 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:33.419885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730949c2-ebb1-4160-b998-b5af33bbc820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:33.446749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-730949c2-ebb1-4160-b998-b5af33bbc820 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:33.447982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-730949c2-ebb1-4160-b998-b5af33bbc820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:33.562177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafc347-e3ff-4a5f-be52-557bf0791892 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:33.562408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1091/2157] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:33.563741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafc347-e3ff-4a5f-be52-557bf0791892 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:33.564089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafc347-e3ff-4a5f-be52-557bf0791892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:33.606009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1fafc347-e3ff-4a5f-be52-557bf0791892 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:33.607282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1fafc347-e3ff-4a5f-be52-557bf0791892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:33.617261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1067/2158] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:33.621477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730949c2-ebb1-4160-b998-b5af33bbc820 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:33.631726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730949c2-ebb1-4160-b998-b5af33bbc820 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:33.638282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:33.639144 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:33.639491 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:33.639918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:33.652537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:33.652537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:33.652537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:33.658630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1092/2159] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:11:33.663043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafc347-e3ff-4a5f-be52-557bf0791892 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:33.676083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafc347-e3ff-4a5f-be52-557bf0791892 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:33.682374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd408d-d00f-421d-adcc-fb3375f4ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:33.683006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd408d-d00f-421d-adcc-fb3375f4ae9d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:33.683284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd408d-d00f-421d-adcc-fb3375f4ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:33.683555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd408d-d00f-421d-adcc-fb3375f4ae9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:33.684354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd408d-d00f-421d-adcc-fb3375f4ae9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:33.686296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd408d-d00f-421d-adcc-fb3375f4ae9d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:33.819440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1068/2160] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:33 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:33.820390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:33.834634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb762b4d-8a44-4ea7-a20d-1cb7edc0806b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:33.893200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:33.922068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e6fe-2a2d-4124-818b-749b48667b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:33.922773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e6fe-2a2d-4124-818b-749b48667b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:33.923105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e6fe-2a2d-4124-818b-749b48667b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:33.923438 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e6fe-2a2d-4124-818b-749b48667b12 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:33.924126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e6fe-2a2d-4124-818b-749b48667b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:33.926125 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e6fe-2a2d-4124-818b-749b48667b12 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:34.052988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1093/2161] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:33 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:34.057203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd408d-d00f-421d-adcc-fb3375f4ae9d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:34.072375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd408d-d00f-421d-adcc-fb3375f4ae9d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:34.095576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e7f59-59ff-4334-a3a3-76bed62455ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:34.096239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e7f59-59ff-4334-a3a3-76bed62455ac admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:34.096670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e7f59-59ff-4334-a3a3-76bed62455ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:34.097021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e7f59-59ff-4334-a3a3-76bed62455ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:34.097752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e7f59-59ff-4334-a3a3-76bed62455ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:34.099822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e7f59-59ff-4334-a3a3-76bed62455ac admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:34.134990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1069/2162] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:34.140678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e6fe-2a2d-4124-818b-749b48667b12 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:34.153314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e6fe-2a2d-4124-818b-749b48667b12 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:34.158702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d412fe-c098-4ed4-b65e-fd27ef7e9508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:34.160530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d412fe-c098-4ed4-b65e-fd27ef7e9508 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:34.160530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d412fe-c098-4ed4-b65e-fd27ef7e9508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:34.160530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d412fe-c098-4ed4-b65e-fd27ef7e9508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:34.161285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d412fe-c098-4ed4-b65e-fd27ef7e9508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:34.166942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d412fe-c098-4ed4-b65e-fd27ef7e9508 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:34.188846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1094/2163] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:34.190256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e7f59-59ff-4334-a3a3-76bed62455ac admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:34.209903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e7f59-59ff-4334-a3a3-76bed62455ac admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:34.222700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b78d-4374-4ea4-95ea-dfeae2164c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:34.223680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b78d-4374-4ea4-95ea-dfeae2164c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:34.225198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b78d-4374-4ea4-95ea-dfeae2164c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:34.225988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5b78d-4374-4ea4-95ea-dfeae2164c2e admin admin] PATH_INFO: `/v3/projects/96e8213da5fe42bfa5aae25603569b61/users/7554c81bd1264e30a49930b6926a2a62/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:34.265668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5b78d-4374-4ea4-95ea-dfeae2164c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e8213da5fe42bfa5aae25603569b61, user_id=7554c81bd1264e30a49930b6926a2a62, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:34.268914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5b78d-4374-4ea4-95ea-dfeae2164c2e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:34.363431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1070/2164] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:34 2022] PUT /identity/v3/projects/96e8213da5fe42bfa5aae25603569b61/users/7554c81bd1264e30a49930b6926a2a62/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:34.381108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a93a8-2155-4df7-8a8e-3dd60624ed56 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:34.381740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a93a8-2155-4df7-8a8e-3dd60624ed56 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:34.382890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a93a8-2155-4df7-8a8e-3dd60624ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:34.496186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b26a93a8-2155-4df7-8a8e-3dd60624ed56 None None] MFA Rules not processed for user `7554c81bd1264e30a49930b6926a2a62`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:34.504830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b26a93a8-2155-4df7-8a8e-3dd60624ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:34.656740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1095/2165] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:34.661409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b78d-4374-4ea4-95ea-dfeae2164c2e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:34.805075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5b78d-4374-4ea4-95ea-dfeae2164c2e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:34.810807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea171b-9023-4fb5-8424-388868e923bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:34.812049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea171b-9023-4fb5-8424-388868e923bc admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:34.812750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea171b-9023-4fb5-8424-388868e923bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:34.813259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea171b-9023-4fb5-8424-388868e923bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:34.814163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea171b-9023-4fb5-8424-388868e923bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:34.816770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea171b-9023-4fb5-8424-388868e923bc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:34.944576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1071/2166] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:34 2022] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:34.956250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a93a8-2155-4df7-8a8e-3dd60624ed56 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:34.974908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a93a8-2155-4df7-8a8e-3dd60624ed56 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:35.090831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d43be6-139e-4851-ae33-d341ffca6c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:35.091759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43be6-139e-4851-ae33-d341ffca6c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:35.092177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43be6-139e-4851-ae33-d341ffca6c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:35.093266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43be6-139e-4851-ae33-d341ffca6c8a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:35.094119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d43be6-139e-4851-ae33-d341ffca6c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:35.098153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d43be6-139e-4851-ae33-d341ffca6c8a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:35.190343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1096/2167] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:34 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:35.193556 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea171b-9023-4fb5-8424-388868e923bc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:35.204897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea171b-9023-4fb5-8424-388868e923bc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:35.209834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b464-8046-44fe-9f2b-33715c93daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:35.211043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b464-8046-44fe-9f2b-33715c93daa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:35.211302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b464-8046-44fe-9f2b-33715c93daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:35.211621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b464-8046-44fe-9f2b-33715c93daa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:35.212311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b464-8046-44fe-9f2b-33715c93daa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:35.214057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b464-8046-44fe-9f2b-33715c93daa6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:35.231512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1072/2168] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:35.235768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d43be6-139e-4851-ae33-d341ffca6c8a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:35.251554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d43be6-139e-4851-ae33-d341ffca6c8a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:35.252379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084eaad-6384-44f3-af16-2d6565d1e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:35.253124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084eaad-6384-44f3-af16-2d6565d1e38b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:35.253444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084eaad-6384-44f3-af16-2d6565d1e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:35.253720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084eaad-6384-44f3-af16-2d6565d1e38b admin admin] PATH_INFO: `/v3/projects/6150ee99d3b144f98abd906d0c91f51b/users/9323fe90b86c4aefb2c9c646e23e9ae2/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:35.281038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084eaad-6384-44f3-af16-2d6565d1e38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6150ee99d3b144f98abd906d0c91f51b, user_id=9323fe90b86c4aefb2c9c646e23e9ae2, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:35.284908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084eaad-6384-44f3-af16-2d6565d1e38b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:35.371879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1097/2169] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:35 2022] PUT /identity/v3/projects/6150ee99d3b144f98abd906d0c91f51b/users/9323fe90b86c4aefb2c9c646e23e9ae2/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:35.375845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b464-8046-44fe-9f2b-33715c93daa6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:35.386859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b464-8046-44fe-9f2b-33715c93daa6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:35.433378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:35.495101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ec16b-f23e-4639-a363-23a6682b5ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:35.502336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ec16b-f23e-4639-a363-23a6682b5ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:35.502793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ec16b-f23e-4639-a363-23a6682b5ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:35.503788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ec16b-f23e-4639-a363-23a6682b5ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:35.505308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ec16b-f23e-4639-a363-23a6682b5ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:35.506936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ec16b-f23e-4639-a363-23a6682b5ceb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:35.529085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084eaad-6384-44f3-af16-2d6565d1e38b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:35.536588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1073/2170] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:35.541262 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084eaad-6384-44f3-af16-2d6565d1e38b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:35.548501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:35.549575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:35.550165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:35.550577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] PATH_INFO: `/v3/projects/6150ee99d3b144f98abd906d0c91f51b/users/9323fe90b86c4aefb2c9c646e23e9ae2/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:35.555845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6150ee99d3b144f98abd906d0c91f51b, user_id=9323fe90b86c4aefb2c9c646e23e9ae2, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:35.560016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:35.568330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:35.574815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1098/2171] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:35 2022] PUT /identity/v3/projects/6150ee99d3b144f98abd906d0c91f51b/users/9323fe90b86c4aefb2c9c646e23e9ae2/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:35.585672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264422-d26b-4ef0-98dd-4e29d4f67644 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:35.586805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264422-d26b-4ef0-98dd-4e29d4f67644 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:35.587421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264422-d26b-4ef0-98dd-4e29d4f67644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:35.626813 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c2264422-d26b-4ef0-98dd-4e29d4f67644 None None] MFA Rules not processed for user `9323fe90b86c4aefb2c9c646e23e9ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:35.633395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c2264422-d26b-4ef0-98dd-4e29d4f67644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:35.806763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1074/2172] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:35.820346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:35.822465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:35.935247 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366dd4-38c5-4471-ace2-c0b522d8fee2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:35.939367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:35.939989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:35.940275 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:35.941171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:35.953467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:35.955271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:35.987342 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1099/2173] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:36.246282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264422-d26b-4ef0-98dd-4e29d4f67644 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:36.259936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264422-d26b-4ef0-98dd-4e29d4f67644 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:36.285059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7950b26-4c2f-4381-8f3d-8debbb47bf6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:36.287511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950b26-4c2f-4381-8f3d-8debbb47bf6c service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:36.288817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950b26-4c2f-4381-8f3d-8debbb47bf6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:36.291313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950b26-4c2f-4381-8f3d-8debbb47bf6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:36.445226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7950b26-4c2f-4381-8f3d-8debbb47bf6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:36.447306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7950b26-4c2f-4381-8f3d-8debbb47bf6c service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:36.471223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1075/2174] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:37.201684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:37.204150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:37.407651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349b381-9680-4d4c-a85c-5b0f1378aa67 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:37.423997 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:37.427061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:37.428053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:37.439618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] PATH_INFO: `/v3/users/6452ad1301fb4f2aa2f0c015463455c4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:37.456753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6452ad1301fb4f2aa2f0c015463455c4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:37.459117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:37.689077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b32464-ecc4-4631-b003-79c1b7af63e7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:37.689625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b32464-ecc4-4631-b003-79c1b7af63e7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:37.689625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b32464-ecc4-4631-b003-79c1b7af63e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:37.708114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6452ad1301fb4f2aa2f0c015463455c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:37.730894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6452ad1301fb4f2aa2f0c015463455c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:37.735749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f4b32464-ecc4-4631-b003-79c1b7af63e7 None None] MFA Rules not processed for user `3fed5d075e284f428bee68330ff204b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:37.735749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f4b32464-ecc4-4631-b003-79c1b7af63e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:37.742294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6452ad1301fb4f2aa2f0c015463455c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:37.776998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:37.805840 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6452ad1301fb4f2aa2f0c015463455c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:37.806739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6452ad1301fb4f2aa2f0c015463455c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:37.814167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1100/2175] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:37 2022] DELETE /identity/v3/users/6452ad1301fb4f2aa2f0c015463455c4 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:37.841753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1076/2176] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:37.857174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:37.858728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:37.895711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:37.962037 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957662d-3a79-4d0c-8e5d-8d7df4344fb2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:37.969200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7c0e7-b66f-4cf1-81e7-e48574ca2c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:37.969853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c0e7-b66f-4cf1-81e7-e48574ca2c70 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:37.970134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c0e7-b66f-4cf1-81e7-e48574ca2c70 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:37.970408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c0e7-b66f-4cf1-81e7-e48574ca2c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:37.972302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-61c7c0e7-b66f-4cf1-81e7-e48574ca2c70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:38.055696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7c0e7-b66f-4cf1-81e7-e48574ca2c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:38.063413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7c0e7-b66f-4cf1-81e7-e48574ca2c70 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:38.074689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1101/2177] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:38.227633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b32464-ecc4-4631-b003-79c1b7af63e7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:38.232771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f4b32464-ecc4-4631-b003-79c1b7af63e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:38.249693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b32464-ecc4-4631-b003-79c1b7af63e7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:38.325706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:38.326460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:38.326744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:38.330738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] PATH_INFO: `/v3/projects/ef0871bc1c2b4276afb1d8ad77fda839` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:38.330738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0871bc1c2b4276afb1d8ad77fda839)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:38.331238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:38.497602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0871bc1c2b4276afb1d8ad77fda839', 'request_id': 'req-80f2e38d-a752-4e66-b141-116922cbcac3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:38.583661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0871bc1c2b4276afb1d8ad77fda839', 'request_id': 'req-80f2e38d-a752-4e66-b141-116922cbcac3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:38.599848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0871bc1c2b4276afb1d8ad77fda839', 'request_id': 'req-80f2e38d-a752-4e66-b141-116922cbcac3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:38.620662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] The token cache is being invalidate because project ef0871bc1c2b4276afb1d8ad77fda839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:38.621031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:38.621742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-80f2e38d-a752-4e66-b141-116922cbcac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:38.623356 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1077/2178] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:38 2022] DELETE /identity/v3/projects/ef0871bc1c2b4276afb1d8ad77fda839 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:38.630990 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4088e-6038-47ac-bb2a-4a5e09722583 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:38.631852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4088e-6038-47ac-bb2a-4a5e09722583 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:38.635131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4088e-6038-47ac-bb2a-4a5e09722583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:38.661034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-84d4088e-6038-47ac-bb2a-4a5e09722583 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:38.661034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-84d4088e-6038-47ac-bb2a-4a5e09722583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:38.753526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47613-fc8f-4e8a-8ddf-fa6152f2e61b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:38.754590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47613-fc8f-4e8a-8ddf-fa6152f2e61b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:38.755024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47613-fc8f-4e8a-8ddf-fa6152f2e61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:38.761749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1102/2179] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:38.780547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-74b47613-fc8f-4e8a-8ddf-fa6152f2e61b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:38.781788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-74b47613-fc8f-4e8a-8ddf-fa6152f2e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:38.791115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1078/2180] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:38.795123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4088e-6038-47ac-bb2a-4a5e09722583 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:38.805904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4088e-6038-47ac-bb2a-4a5e09722583 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:38.810752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:38.811637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:38.812107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:38.812407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:38.813146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:38.813458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:38.815079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:38.833472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1103/2181] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:11:38.836071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b47613-fc8f-4e8a-8ddf-fa6152f2e61b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:38.846060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b47613-fc8f-4e8a-8ddf-fa6152f2e61b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:38.852607 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6c263-d2a2-423a-be53-5c50076f280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:38.853248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6c263-d2a2-423a-be53-5c50076f280e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:38.853512 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6c263-d2a2-423a-be53-5c50076f280e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:38.853785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6c263-d2a2-423a-be53-5c50076f280e admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:38.854419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6c263-d2a2-423a-be53-5c50076f280e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:38.856542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6c263-d2a2-423a-be53-5c50076f280e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:38.945581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1079/2182] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:38 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:38.948960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:38.961040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e063a0-50c4-4d1b-aaac-ae66304bcfc9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:39.019313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:39.035982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52630486-7e8d-4ded-8af1-58d6de326321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:39.036801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52630486-7e8d-4ded-8af1-58d6de326321 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:39.037120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52630486-7e8d-4ded-8af1-58d6de326321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:39.037467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52630486-7e8d-4ded-8af1-58d6de326321 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:39.038998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52630486-7e8d-4ded-8af1-58d6de326321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:39.041878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52630486-7e8d-4ded-8af1-58d6de326321 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:39.158964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1104/2183] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:38 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:39.162921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6c263-d2a2-423a-be53-5c50076f280e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:39.175021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6c263-d2a2-423a-be53-5c50076f280e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:39.183450 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b500f-c63c-40a5-93a5-be062d53061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:39.184279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b500f-c63c-40a5-93a5-be062d53061d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:39.184712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b500f-c63c-40a5-93a5-be062d53061d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:39.184906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b500f-c63c-40a5-93a5-be062d53061d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:39.186020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b500f-c63c-40a5-93a5-be062d53061d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:39.187264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b500f-c63c-40a5-93a5-be062d53061d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:39.197819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1080/2184] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:39.202130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52630486-7e8d-4ded-8af1-58d6de326321 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:39.213375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52630486-7e8d-4ded-8af1-58d6de326321 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:39.218523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b4ae8-eeb2-46dd-8791-dcb412884dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:39.219131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4ae8-eeb2-46dd-8791-dcb412884dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:39.219416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4ae8-eeb2-46dd-8791-dcb412884dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:39.219693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4ae8-eeb2-46dd-8791-dcb412884dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:39.220338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b4ae8-eeb2-46dd-8791-dcb412884dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:39.222048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b4ae8-eeb2-46dd-8791-dcb412884dd6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:39.234737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1105/2185] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:39.239240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b500f-c63c-40a5-93a5-be062d53061d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:39.250095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b500f-c63c-40a5-93a5-be062d53061d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:39.255245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:39.255919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:39.256199 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:39.256493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] PATH_INFO: `/v3/projects/677200be9d434857877c452db7ad4b20/users/338bde3096e44d81b2157690c75bfa05/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:39.277389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] RBAC: Authorizing `identity:create_grant(project_id=677200be9d434857877c452db7ad4b20, user_id=338bde3096e44d81b2157690c75bfa05, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:39.282396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:39.291940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:39.379314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1081/2186] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:39 2022] PUT /identity/v3/projects/677200be9d434857877c452db7ad4b20/users/338bde3096e44d81b2157690c75bfa05/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:39.384867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444226-36d5-4584-ab59-e6af80642515 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:39.385160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444226-36d5-4584-ab59-e6af80642515 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:39.385456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444226-36d5-4584-ab59-e6af80642515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:39.406460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-28444226-36d5-4584-ab59-e6af80642515 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:39.407738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-28444226-36d5-4584-ab59-e6af80642515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:39.483673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1106/2187] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:39.495328 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:39.498292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:39.563903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824ab3-75eb-4dd2-966e-6c92d9ba456a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:39.567936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:39.568613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:39.568858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:39.569134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:39.580377 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:39.582022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:39.593640 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1082/2188] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:41.608864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad41f-f07d-46ab-a60c-be6fa57fc1d5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:41.609377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad41f-f07d-46ab-a60c-be6fa57fc1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:41.609470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad41f-f07d-46ab-a60c-be6fa57fc1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:41.646916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f31ad41f-f07d-46ab-a60c-be6fa57fc1d5 None None] MFA Rules not processed for user `578c0a0a8f0544949a4771a651b2ee1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:41.649325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f31ad41f-f07d-46ab-a60c-be6fa57fc1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:41.735707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1107/2189] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:45.000015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:45.001939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:45.015449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630c062-b4fa-4c38-8b19-a22751f60199 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:45.020369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:45.021081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:45.021361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:45.021635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] PATH_INFO: `/v3/users/7554c81bd1264e30a49930b6926a2a62` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:45.031140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7554c81bd1264e30a49930b6926a2a62)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:45.032822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:45.250719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7554c81bd1264e30a49930b6926a2a62'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:45.266802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7554c81bd1264e30a49930b6926a2a62'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:45.282269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7554c81bd1264e30a49930b6926a2a62'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:45.379444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7554c81bd1264e30a49930b6926a2a62'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:45.380087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7554c81bd1264e30a49930b6926a2a62'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:45.388179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1083/2190] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:44 2022] DELETE /identity/v3/users/7554c81bd1264e30a49930b6926a2a62 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:45.392833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208013-5928-4a9b-af1c-3e5373a042a6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:45.394093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208013-5928-4a9b-af1c-3e5373a042a6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:45.394715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6208013-5928-4a9b-af1c-3e5373a042a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:45.431695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f6208013-5928-4a9b-af1c-3e5373a042a6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:45.433198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f6208013-5928-4a9b-af1c-3e5373a042a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:45.537321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1108/2191] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:11:45.551658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:45.557157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:45.665571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658ec47-510e-4d95-be20-559f7d5a1694 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:45.672399 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:45.675552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:45.676062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:45.678839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:45.694302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:45.697620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:45.707897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1084/2192] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:46.300837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162eaf-62bf-4829-82c2-fa4c35667f65 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:46.300837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162eaf-62bf-4829-82c2-fa4c35667f65 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:46.300837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162eaf-62bf-4829-82c2-fa4c35667f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:46.305188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:46.307189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:46.326582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e32e-aa71-4b5d-a9bc-c34031664c78 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:46.332468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:46.333159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:46.333540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:46.333722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] PATH_INFO: `/v3/projects/96e8213da5fe42bfa5aae25603569b61` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:46.335382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e8213da5fe42bfa5aae25603569b61)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:46.337409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:46.342044 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:46.347760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:46.354135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b6162eaf-62bf-4829-82c2-fa4c35667f65 None None] MFA Rules not processed for user `338bde3096e44d81b2157690c75bfa05`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:46.355433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b6162eaf-62bf-4829-82c2-fa4c35667f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:46.441059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1109/2193] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:46.443164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9c5c-fc52-46c5-8d54-352c0e1d8a45 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:46.443649 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9c5c-fc52-46c5-8d54-352c0e1d8a45 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:46.443897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9c5c-fc52-46c5-8d54-352c0e1d8a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:46.453834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e8213da5fe42bfa5aae25603569b61', 'request_id': 'req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.494161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fc2e9c5c-fc52-46c5-8d54-352c0e1d8a45 None None] MFA Rules not processed for user `338bde3096e44d81b2157690c75bfa05`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:46.495528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fc2e9c5c-fc52-46c5-8d54-352c0e1d8a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:46.545956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e8213da5fe42bfa5aae25603569b61', 'request_id': 'req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.553732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e8213da5fe42bfa5aae25603569b61', 'request_id': 'req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.571485 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1110/2194] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:46.571626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] The token cache is being invalidate because project 96e8213da5fe42bfa5aae25603569b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:46.571626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.571626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.573169 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e9c5c-fc52-46c5-8d54-352c0e1d8a45 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:46.575308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fc2e9c5c-fc52-46c5-8d54-352c0e1d8a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:46.592285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1085/2195] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:46 2022] DELETE /identity/v3/projects/96e8213da5fe42bfa5aae25603569b61 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:46.593578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:46.595150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:46.683452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732d3f1-6ef6-44e7-aa6f-a9a43aa07c91 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:46.688602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:46.689257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e9c5c-fc52-46c5-8d54-352c0e1d8a45 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:46.689395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:46.689677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:46.691523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] PATH_INFO: `/v3/users/9323fe90b86c4aefb2c9c646e23e9ae2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:46.692787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9323fe90b86c4aefb2c9c646e23e9ae2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:46.695547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:46.698035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:46.703508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:46.703508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:46.703508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:46.703508 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:46.714814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:46.717529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:46.729715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1111/2196] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:11:46.904363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9323fe90b86c4aefb2c9c646e23e9ae2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.914633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9323fe90b86c4aefb2c9c646e23e9ae2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.933539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9323fe90b86c4aefb2c9c646e23e9ae2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.994960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9323fe90b86c4aefb2c9c646e23e9ae2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:46.995511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8234faa7-a826-4aab-82e7-638ed73028c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9323fe90b86c4aefb2c9c646e23e9ae2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:47.002061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1086/2197] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:11:46 2022] DELETE /identity/v3/users/9323fe90b86c4aefb2c9c646e23e9ae2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:47.762532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:47.776788 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449bbae-25a2-4daf-8c39-b77d52aeef35 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:47.802269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d44f7-7c6f-4db3-987b-bf39fbb59b70 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:47.802780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d44f7-7c6f-4db3-987b-bf39fbb59b70 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:47.802889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d44f7-7c6f-4db3-987b-bf39fbb59b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:47.828074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-431d44f7-7c6f-4db3-987b-bf39fbb59b70 None None] MFA Rules not processed for user `338bde3096e44d81b2157690c75bfa05`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:47.829759 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-431d44f7-7c6f-4db3-987b-bf39fbb59b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:47.832887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:47.859698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:47.871693 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:47.872629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:47.873113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:47.873392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] PATH_INFO: `/v3/projects/6150ee99d3b144f98abd906d0c91f51b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:47.878569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6150ee99d3b144f98abd906d0c91f51b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:47.880841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:47.939705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1087/2198] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:48.032733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6150ee99d3b144f98abd906d0c91f51b', 'request_id': 'req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:48.039951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6150ee99d3b144f98abd906d0c91f51b', 'request_id': 'req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:48.049855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6150ee99d3b144f98abd906d0c91f51b', 'request_id': 'req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:48.169515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] The token cache is being invalidate because project 6150ee99d3b144f98abd906d0c91f51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:11:48.169515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:48.174796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c39fc0cf-6bc6-49c4-8e0b-4cc62cf9d8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:11:48.176534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1112/2199] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:11:47 2022] DELETE /identity/v3/projects/6150ee99d3b144f98abd906d0c91f51b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:48.182337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44226-c8a1-4782-afde-68aee1cc3c98 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:48.182633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44226-c8a1-4782-afde-68aee1cc3c98 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:48.182916 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44226-c8a1-4782-afde-68aee1cc3c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:48.203798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c8e44226-c8a1-4782-afde-68aee1cc3c98 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:48.205832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c8e44226-c8a1-4782-afde-68aee1cc3c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:48.283176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1088/2200] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:48.285712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744f8e-41b0-4731-aec9-f384d9d32bd2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:48.286005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744f8e-41b0-4731-aec9-f384d9d32bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:48.286281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744f8e-41b0-4731-aec9-f384d9d32bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:48.328556 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-57744f8e-41b0-4731-aec9-f384d9d32bd2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:48.331475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-57744f8e-41b0-4731-aec9-f384d9d32bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:48.348136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1113/2201] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:48.352575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e44226-c8a1-4782-afde-68aee1cc3c98 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:48.362928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e44226-c8a1-4782-afde-68aee1cc3c98 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:48.369492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:48.370189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:48.370476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:48.370754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:48.371420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:11:48.371726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:48.373360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:48.388539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1089/2202] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:11:48.390319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744f8e-41b0-4731-aec9-f384d9d32bd2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:48.420381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744f8e-41b0-4731-aec9-f384d9d32bd2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:48.437597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef966a8-42ac-4b76-82b5-b18a8ff2bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:48.438260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef966a8-42ac-4b76-82b5-b18a8ff2bf91 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:48.438552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef966a8-42ac-4b76-82b5-b18a8ff2bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:48.438847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef966a8-42ac-4b76-82b5-b18a8ff2bf91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:48.439554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef966a8-42ac-4b76-82b5-b18a8ff2bf91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:48.443177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef966a8-42ac-4b76-82b5-b18a8ff2bf91 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:48.866136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1114/2203] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:48 2022] POST /identity/v3/projects => generated 383 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:48.866726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:48.868854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21020950-684b-4653-afd1-540427d3ee0f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:48.959978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b649f-ee5f-429b-bd4f-30bcf2bc79cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:48.960766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b649f-ee5f-429b-bd4f-30bcf2bc79cb admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:48.961149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b649f-ee5f-429b-bd4f-30bcf2bc79cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:48.961774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b649f-ee5f-429b-bd4f-30bcf2bc79cb admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:48.962434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b649f-ee5f-429b-bd4f-30bcf2bc79cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:48.964897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b649f-ee5f-429b-bd4f-30bcf2bc79cb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:49.106027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1090/2204] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:48 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:49.110030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef966a8-42ac-4b76-82b5-b18a8ff2bf91 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:49.126696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef966a8-42ac-4b76-82b5-b18a8ff2bf91 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:49.139574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199344d0-df20-4577-aa17-f189412331a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:49.141547 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199344d0-df20-4577-aa17-f189412331a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:49.141839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199344d0-df20-4577-aa17-f189412331a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:49.144378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199344d0-df20-4577-aa17-f189412331a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:49.145316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199344d0-df20-4577-aa17-f189412331a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:49.148926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199344d0-df20-4577-aa17-f189412331a6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:49.189656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1115/2205] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:49.193931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b649f-ee5f-429b-bd4f-30bcf2bc79cb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:49.218632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b649f-ee5f-429b-bd4f-30bcf2bc79cb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:49.242709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9a27-6876-4bbc-8b17-6c5b3ebd0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:49.243350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9a27-6876-4bbc-8b17-6c5b3ebd0129 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:49.244235 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9a27-6876-4bbc-8b17-6c5b3ebd0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:49.247010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9a27-6876-4bbc-8b17-6c5b3ebd0129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:49.249351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9a27-6876-4bbc-8b17-6c5b3ebd0129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:49.253440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9a27-6876-4bbc-8b17-6c5b3ebd0129 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:49.319550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1091/2206] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:49.328622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199344d0-df20-4577-aa17-f189412331a6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:49.347094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199344d0-df20-4577-aa17-f189412331a6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:49.354724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897a4db-2d85-40ef-a0d0-c0bfa711a476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:49.356102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a4db-2d85-40ef-a0d0-c0bfa711a476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:49.356102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a4db-2d85-40ef-a0d0-c0bfa711a476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:49.356102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a4db-2d85-40ef-a0d0-c0bfa711a476 admin admin] PATH_INFO: `/v3/projects/a482bdffddd34dec9aaa6325a3192770/users/3411e71e88fc44eba1eb4ad6009d2e20/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:49.380711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897a4db-2d85-40ef-a0d0-c0bfa711a476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a482bdffddd34dec9aaa6325a3192770, user_id=3411e71e88fc44eba1eb4ad6009d2e20, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:49.384746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897a4db-2d85-40ef-a0d0-c0bfa711a476 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:49.496560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1116/2207] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:49 2022] PUT /identity/v3/projects/a482bdffddd34dec9aaa6325a3192770/users/3411e71e88fc44eba1eb4ad6009d2e20/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:49.498335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5135-6d56-4a40-89a5-5aad833ccd2a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:49.498616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5135-6d56-4a40-89a5-5aad833ccd2a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:49.498903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5135-6d56-4a40-89a5-5aad833ccd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:49.531913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-58ba5135-6d56-4a40-89a5-5aad833ccd2a None None] MFA Rules not processed for user `3411e71e88fc44eba1eb4ad6009d2e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:49.533450 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-58ba5135-6d56-4a40-89a5-5aad833ccd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:49.556735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:49.686803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1092/2208] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:49.691293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897a4db-2d85-40ef-a0d0-c0bfa711a476 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:49.861231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:49.870321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897a4db-2d85-40ef-a0d0-c0bfa711a476 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:49.878532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6bd03-bc18-4c00-af32-ba8237a9bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:49.882566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6bd03-bc18-4c00-af32-ba8237a9bbbb admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:49.883441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6bd03-bc18-4c00-af32-ba8237a9bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:49.884929 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6bd03-bc18-4c00-af32-ba8237a9bbbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:49.885700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6bd03-bc18-4c00-af32-ba8237a9bbbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:49.892040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6bd03-bc18-4c00-af32-ba8237a9bbbb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:50.041652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1117/2209] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:49 2022] POST /identity/v3/projects => generated 383 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:50.048379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5135-6d56-4a40-89a5-5aad833ccd2a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:50.060947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5135-6d56-4a40-89a5-5aad833ccd2a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:50.122215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab2af-3700-4f44-bcb6-1cab6a284d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:50.122838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab2af-3700-4f44-bcb6-1cab6a284d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:50.123115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab2af-3700-4f44-bcb6-1cab6a284d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:50.123385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab2af-3700-4f44-bcb6-1cab6a284d41 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:50.124031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab2af-3700-4f44-bcb6-1cab6a284d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:50.125982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab2af-3700-4f44-bcb6-1cab6a284d41 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:50.220703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1093/2210] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:50 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:50.225114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6bd03-bc18-4c00-af32-ba8237a9bbbb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:50.238285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6bd03-bc18-4c00-af32-ba8237a9bbbb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:50.249516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2bc0-f23d-4966-86cc-696b5367d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:50.250158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2bc0-f23d-4966-86cc-696b5367d3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:50.252674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2bc0-f23d-4966-86cc-696b5367d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:50.252967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2bc0-f23d-4966-86cc-696b5367d3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:50.253645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc2bc0-f23d-4966-86cc-696b5367d3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:50.255496 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc2bc0-f23d-4966-86cc-696b5367d3dd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:50.270945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1118/2211] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:50.276448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab2af-3700-4f44-bcb6-1cab6a284d41 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:50.290168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab2af-3700-4f44-bcb6-1cab6a284d41 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:50.311754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4923-3037-4923-aaa7-f3edeb8dc6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:50.313366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4923-3037-4923-aaa7-f3edeb8dc6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:50.313366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4923-3037-4923-aaa7-f3edeb8dc6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:50.313366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4923-3037-4923-aaa7-f3edeb8dc6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:50.314613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4923-3037-4923-aaa7-f3edeb8dc6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:50.318362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4923-3037-4923-aaa7-f3edeb8dc6f7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:50.337544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1094/2212] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:50.341867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2bc0-f23d-4966-86cc-696b5367d3dd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:50.357150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2bc0-f23d-4966-86cc-696b5367d3dd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:50.357881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65a117-822c-4d68-8b02-c24af88fa51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:50.358541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65a117-822c-4d68-8b02-c24af88fa51d admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:50.358818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65a117-822c-4d68-8b02-c24af88fa51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:50.359394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65a117-822c-4d68-8b02-c24af88fa51d admin admin] PATH_INFO: `/v3/projects/a0e650ffea534ab3bd47b4a460943b18/users/796ef791f83f4940b96465a54ecbce26/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:50.402552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65a117-822c-4d68-8b02-c24af88fa51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e650ffea534ab3bd47b4a460943b18, user_id=796ef791f83f4940b96465a54ecbce26, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:50.405551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65a117-822c-4d68-8b02-c24af88fa51d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:50.507808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1119/2213] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:50 2022] PUT /identity/v3/projects/a0e650ffea534ab3bd47b4a460943b18/users/796ef791f83f4940b96465a54ecbce26/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:50.518801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003122c-725d-42e8-92c8-8e75c6bf88b9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:50.519159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003122c-725d-42e8-92c8-8e75c6bf88b9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:50.519529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003122c-725d-42e8-92c8-8e75c6bf88b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:50.562492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b003122c-725d-42e8-92c8-8e75c6bf88b9 None None] MFA Rules not processed for user `796ef791f83f4940b96465a54ecbce26`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:50.572409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b003122c-725d-42e8-92c8-8e75c6bf88b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:50.638066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1095/2214] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:50.647093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65a117-822c-4d68-8b02-c24af88fa51d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:50.733609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65a117-822c-4d68-8b02-c24af88fa51d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:50.738538 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247349cb-380d-423a-b003-0f8b4039a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:50.739887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247349cb-380d-423a-b003-0f8b4039a8ad admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:50.739887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247349cb-380d-423a-b003-0f8b4039a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:50.739887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247349cb-380d-423a-b003-0f8b4039a8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:50.741394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247349cb-380d-423a-b003-0f8b4039a8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:50.744503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247349cb-380d-423a-b003-0f8b4039a8ad admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:50.879824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1120/2215] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:11:50 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:11:50.883803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003122c-725d-42e8-92c8-8e75c6bf88b9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:50.926026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003122c-725d-42e8-92c8-8e75c6bf88b9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:50.964900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:51.025660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a0906-89a3-41a7-aa18-a1f34363bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:51.026340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a0906-89a3-41a7-aa18-a1f34363bfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:51.026613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a0906-89a3-41a7-aa18-a1f34363bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:51.026888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a0906-89a3-41a7-aa18-a1f34363bfb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:51.027562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a0906-89a3-41a7-aa18-a1f34363bfb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:51.030894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a0906-89a3-41a7-aa18-a1f34363bfb5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:51.159850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1096/2216] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:11:50 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:11:51.164340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247349cb-380d-423a-b003-0f8b4039a8ad admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:51.197429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247349cb-380d-423a-b003-0f8b4039a8ad admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:51.202297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ce08e-6930-41ac-a4f7-d33954d6398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:51.202924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce08e-6930-41ac-a4f7-d33954d6398e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:51.203199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce08e-6930-41ac-a4f7-d33954d6398e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:51.203967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ce08e-6930-41ac-a4f7-d33954d6398e admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:51.204829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ce08e-6930-41ac-a4f7-d33954d6398e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:51.209000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ce08e-6930-41ac-a4f7-d33954d6398e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:51.240718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1121/2217] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:11:51.245833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a0906-89a3-41a7-aa18-a1f34363bfb5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:51.260593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a0906-89a3-41a7-aa18-a1f34363bfb5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:51.273394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764925f-cac2-430a-be8a-06aa9bedde2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:51.274486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764925f-cac2-430a-be8a-06aa9bedde2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:51.274774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764925f-cac2-430a-be8a-06aa9bedde2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:51.275127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764925f-cac2-430a-be8a-06aa9bedde2f admin admin] PATH_INFO: `/v3/projects/a70063afff524d518244d53f339f3e08/users/d933db4deb9a45e9924f7a427e26cde7/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:51.327812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764925f-cac2-430a-be8a-06aa9bedde2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70063afff524d518244d53f339f3e08, user_id=d933db4deb9a45e9924f7a427e26cde7, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:51.334550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764925f-cac2-430a-be8a-06aa9bedde2f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:51.446038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1097/2218] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:51 2022] PUT /identity/v3/projects/a70063afff524d518244d53f339f3e08/users/d933db4deb9a45e9924f7a427e26cde7/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:11:51.448376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ce08e-6930-41ac-a4f7-d33954d6398e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:51.481199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ce08e-6930-41ac-a4f7-d33954d6398e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:51.583972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae3716-1012-48f7-8fe3-8cd2b0ae8961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:51.584767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3716-1012-48f7-8fe3-8cd2b0ae8961 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:51.585056 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3716-1012-48f7-8fe3-8cd2b0ae8961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:51.585488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3716-1012-48f7-8fe3-8cd2b0ae8961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:51.586142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae3716-1012-48f7-8fe3-8cd2b0ae8961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:51.587753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae3716-1012-48f7-8fe3-8cd2b0ae8961 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:51.600568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1122/2219] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:11:51.605243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764925f-cac2-430a-be8a-06aa9bedde2f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:51.624299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764925f-cac2-430a-be8a-06aa9bedde2f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:51.633700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:51.634944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:51.634944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:51.634944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] PATH_INFO: `/v3/projects/a70063afff524d518244d53f339f3e08/users/d933db4deb9a45e9924f7a427e26cde7/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:51.637352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70063afff524d518244d53f339f3e08, user_id=d933db4deb9a45e9924f7a427e26cde7, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:51.640057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:51.652546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1098/2220] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:11:51 2022] PUT /identity/v3/projects/a70063afff524d518244d53f339f3e08/users/d933db4deb9a45e9924f7a427e26cde7/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:11:51.663798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5a92-84e6-4605-9913-320c3a23a4ea None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:51.664243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5a92-84e6-4605-9913-320c3a23a4ea None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:51.669591 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5a92-84e6-4605-9913-320c3a23a4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:51.701701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-71fc5a92-84e6-4605-9913-320c3a23a4ea None None] MFA Rules not processed for user `d933db4deb9a45e9924f7a427e26cde7`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:11:51.703207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-71fc5a92-84e6-4605-9913-320c3a23a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:51.709865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:51.848656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1123/2221] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:11:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:11:51.859705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:51.863464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:51.932226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621ba60-df68-4369-a72d-c18a9f0dc29b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:51.938750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297b30d-0a46-4dce-853a-2d627b85ce09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:51.941030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b30d-0a46-4dce-853a-2d627b85ce09 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:51.943747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b30d-0a46-4dce-853a-2d627b85ce09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:51.943747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b30d-0a46-4dce-853a-2d627b85ce09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:52.017792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297b30d-0a46-4dce-853a-2d627b85ce09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:52.019327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297b30d-0a46-4dce-853a-2d627b85ce09 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:52.031139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1099/2222] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:56.349267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc5a92-84e6-4605-9913-320c3a23a4ea None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:56.350956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-71fc5a92-84e6-4605-9913-320c3a23a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:11:56.366181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc5a92-84e6-4605-9913-320c3a23a4ea None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:56.369985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:56.370605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:56.370884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:56.371154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:56.426703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:56.428125 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:56.437526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1124/2223] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:11:57.888721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297b30d-0a46-4dce-853a-2d627b85ce09 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:11:57.896967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297b30d-0a46-4dce-853a-2d627b85ce09 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:11:57.901609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad1a80-5b10-47fa-9e17-fe1d6f702b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:11:57.902292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1a80-5b10-47fa-9e17-fe1d6f702b90 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:11:57.902577 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1a80-5b10-47fa-9e17-fe1d6f702b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:11:57.902875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1a80-5b10-47fa-9e17-fe1d6f702b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:11:57.915408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad1a80-5b10-47fa-9e17-fe1d6f702b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:11:57.917023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad1a80-5b10-47fa-9e17-fe1d6f702b90 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:11:57.929791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1100/2224] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:11:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:02.209798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:02.211280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:02.285620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77555-6483-4b68-9a61-ebe376b6b507 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:02.291629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:02.292380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:02.292884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:02.293099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] PATH_INFO: `/v3/users/6c965da1efbe42d9bc3466b60d27182a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:02.294254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c965da1efbe42d9bc3466b60d27182a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:02.296248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:02.533217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:02.538688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c965da1efbe42d9bc3466b60d27182a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:02.552579 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c965da1efbe42d9bc3466b60d27182a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:02.560110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c965da1efbe42d9bc3466b60d27182a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:02.703954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c965da1efbe42d9bc3466b60d27182a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:02.704868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c965da1efbe42d9bc3466b60d27182a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:02.713467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1125/2225] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:12:02 2022] DELETE /identity/v3/users/6c965da1efbe42d9bc3466b60d27182a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:02.719525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed706ed-dae9-4614-82f2-c735f6494da6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:02.720078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed706ed-dae9-4614-82f2-c735f6494da6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:02.720078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed706ed-dae9-4614-82f2-c735f6494da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:02.740133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2ed706ed-dae9-4614-82f2-c735f6494da6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:02.741364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2ed706ed-dae9-4614-82f2-c735f6494da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:02.758844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:02.807025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1101/2226] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:02.816841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:02.818254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:02.875749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bc4c-e70c-4989-94eb-57656d2083cb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:02.879346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b79cb-a022-4c36-9355-6781f2bddf5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:02.879950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b79cb-a022-4c36-9355-6781f2bddf5f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:02.880231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b79cb-a022-4c36-9355-6781f2bddf5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:02.880526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b79cb-a022-4c36-9355-6781f2bddf5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:02.890158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b79cb-a022-4c36-9355-6781f2bddf5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:02.891582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b79cb-a022-4c36-9355-6781f2bddf5f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:02.901471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1126/2227] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:03.327857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed706ed-dae9-4614-82f2-c735f6494da6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:03.329337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2ed706ed-dae9-4614-82f2-c735f6494da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:03.342540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed706ed-dae9-4614-82f2-c735f6494da6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:03.347335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:03.353207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:03.353207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:03.353207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] PATH_INFO: `/v3/projects/e9a3debebeb848fa8c2409d96a4c4588` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:03.353207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a3debebeb848fa8c2409d96a4c4588)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:03.353207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:03.437569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a3debebeb848fa8c2409d96a4c4588', 'request_id': 'req-9776576d-7a9d-4e24-b2fa-901d1f593fa3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:03.480538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a3debebeb848fa8c2409d96a4c4588', 'request_id': 'req-9776576d-7a9d-4e24-b2fa-901d1f593fa3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:03.487958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a3debebeb848fa8c2409d96a4c4588', 'request_id': 'req-9776576d-7a9d-4e24-b2fa-901d1f593fa3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:03.500708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] The token cache is being invalidate because project e9a3debebeb848fa8c2409d96a4c4588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:12:03.501251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:03.501953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9776576d-7a9d-4e24-b2fa-901d1f593fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:03.503435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1102/2228] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:12:03 2022] DELETE /identity/v3/projects/e9a3debebeb848fa8c2409d96a4c4588 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:03.509349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5045c-032d-44ec-a0a5-a12bef19fa57 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:03.509835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5045c-032d-44ec-a0a5-a12bef19fa57 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:03.510058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5045c-032d-44ec-a0a5-a12bef19fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:03.530978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d0b5045c-032d-44ec-a0a5-a12bef19fa57 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:03.532186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d0b5045c-032d-44ec-a0a5-a12bef19fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:03.610802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1127/2229] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:03.622612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226166d4-889b-4151-ae8c-778ed8ea7774 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:03.622896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226166d4-889b-4151-ae8c-778ed8ea7774 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:03.623170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226166d4-889b-4151-ae8c-778ed8ea7774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:03.643174 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-226166d4-889b-4151-ae8c-778ed8ea7774 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:03.644413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-226166d4-889b-4151-ae8c-778ed8ea7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:03.652503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1103/2230] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:03.656748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5045c-032d-44ec-a0a5-a12bef19fa57 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:03.667304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5045c-032d-44ec-a0a5-a12bef19fa57 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:03.672086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:03.672756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:03.673045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:03.673321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:03.673978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:12:03.674287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:03.675945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:03.692217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1128/2231] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:12:03.695425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226166d4-889b-4151-ae8c-778ed8ea7774 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:03.704809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226166d4-889b-4151-ae8c-778ed8ea7774 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:03.709644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2b8c9-0da9-409d-a175-daf3f25608f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:03.710248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2b8c9-0da9-409d-a175-daf3f25608f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:03.710528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2b8c9-0da9-409d-a175-daf3f25608f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:03.710849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2b8c9-0da9-409d-a175-daf3f25608f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:03.711494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2b8c9-0da9-409d-a175-daf3f25608f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:03.713522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2b8c9-0da9-409d-a175-daf3f25608f8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:03.801677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1104/2232] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:12:03 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:03.806586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:03.816443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfa096-16d7-49c0-a49a-aa5414e97d7f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:03.865085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:03.878419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c8cc6-23b0-4df0-bf20-ba6ea0c9ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:03.879823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8cc6-23b0-4df0-bf20-ba6ea0c9ad98 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:03.880114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8cc6-23b0-4df0-bf20-ba6ea0c9ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:03.880391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8cc6-23b0-4df0-bf20-ba6ea0c9ad98 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:03.881115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c8cc6-23b0-4df0-bf20-ba6ea0c9ad98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:03.883097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c8cc6-23b0-4df0-bf20-ba6ea0c9ad98 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:03.989775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1129/2233] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:12:03 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:03.994232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2b8c9-0da9-409d-a175-daf3f25608f8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:04.004451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2b8c9-0da9-409d-a175-daf3f25608f8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:04.008982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3031-69cd-42a0-aa2f-d9503415a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:04.009571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3031-69cd-42a0-aa2f-d9503415a7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:04.009845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3031-69cd-42a0-aa2f-d9503415a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:04.010170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3031-69cd-42a0-aa2f-d9503415a7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:04.010805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3031-69cd-42a0-aa2f-d9503415a7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:04.012411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3031-69cd-42a0-aa2f-d9503415a7f7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:04.024386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1105/2234] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:12:04.028947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c8cc6-23b0-4df0-bf20-ba6ea0c9ad98 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:04.039711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c8cc6-23b0-4df0-bf20-ba6ea0c9ad98 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:04.044945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459324d-2ce9-442a-ada6-74846d9cb7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:04.045540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459324d-2ce9-442a-ada6-74846d9cb7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:04.045821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459324d-2ce9-442a-ada6-74846d9cb7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:04.046095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459324d-2ce9-442a-ada6-74846d9cb7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:04.046743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459324d-2ce9-442a-ada6-74846d9cb7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:04.048331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459324d-2ce9-442a-ada6-74846d9cb7c5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:04.058857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1130/2235] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:04.062992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3031-69cd-42a0-aa2f-d9503415a7f7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:04.073482 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3031-69cd-42a0-aa2f-d9503415a7f7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:04.078257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:04.079630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:04.079630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:04.079630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] PATH_INFO: `/v3/projects/95cf69324c994650ae4dd4c2cfb6bd02/users/ed184c26b570476a9f0d0c5a6ec8c27d/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:04.094968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cf69324c994650ae4dd4c2cfb6bd02, user_id=ed184c26b570476a9f0d0c5a6ec8c27d, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:04.097829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:04.194866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1106/2236] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:04 2022] PUT /identity/v3/projects/95cf69324c994650ae4dd4c2cfb6bd02/users/ed184c26b570476a9f0d0c5a6ec8c27d/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:04.205450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf8b56-0d52-4a08-adaa-8f0458e49a42 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:04.205736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf8b56-0d52-4a08-adaa-8f0458e49a42 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:04.206011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf8b56-0d52-4a08-adaa-8f0458e49a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:04.235994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1baf8b56-0d52-4a08-adaa-8f0458e49a42 None None] MFA Rules not processed for user `ed184c26b570476a9f0d0c5a6ec8c27d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:04.237234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1baf8b56-0d52-4a08-adaa-8f0458e49a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:04.309421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1131/2237] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:04.319577 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:04.321397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:04.363496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:04.379649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da44d8-8f8a-4a06-b6b2-4534c67c97d3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:04.383378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96640b-71d6-42dd-9827-605a2e6a779f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:04.383975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96640b-71d6-42dd-9827-605a2e6a779f service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:04.384251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96640b-71d6-42dd-9827-605a2e6a779f service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:04.384544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96640b-71d6-42dd-9827-605a2e6a779f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:04.392770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96640b-71d6-42dd-9827-605a2e6a779f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:04.394186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96640b-71d6-42dd-9827-605a2e6a779f service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:04.403468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1107/2238] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:04.699118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf8b56-0d52-4a08-adaa-8f0458e49a42 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:04.700763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1baf8b56-0d52-4a08-adaa-8f0458e49a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:04.774992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf8b56-0d52-4a08-adaa-8f0458e49a42 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:04.779739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:04.780853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:04.780853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:04.781046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] PATH_INFO: `/v3/users/3411e71e88fc44eba1eb4ad6009d2e20` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:04.782102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3411e71e88fc44eba1eb4ad6009d2e20)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:04.784067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:04.999073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3411e71e88fc44eba1eb4ad6009d2e20'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:05.006781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:05.011634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3411e71e88fc44eba1eb4ad6009d2e20'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:05.018282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3411e71e88fc44eba1eb4ad6009d2e20'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:05.101859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3411e71e88fc44eba1eb4ad6009d2e20'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:05.103151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3411e71e88fc44eba1eb4ad6009d2e20'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:05.114403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1132/2239] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:12:04 2022] DELETE /identity/v3/users/3411e71e88fc44eba1eb4ad6009d2e20 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:05.120251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89231d-99ef-4a81-b8f6-95f99baf6726 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:05.120793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89231d-99ef-4a81-b8f6-95f99baf6726 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:05.120931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89231d-99ef-4a81-b8f6-95f99baf6726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:05.151117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7e89231d-99ef-4a81-b8f6-95f99baf6726 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:05.152443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7e89231d-99ef-4a81-b8f6-95f99baf6726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:05.215296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1108/2240] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:05.225151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:05.226920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:05.290645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dab055-c5e5-4956-ae89-ffd6acad6ab3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:05.294674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6d89-0e56-46d8-b071-a0976def86d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:05.295567 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6d89-0e56-46d8-b071-a0976def86d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:05.295937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6d89-0e56-46d8-b071-a0976def86d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:05.296300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6d89-0e56-46d8-b071-a0976def86d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:05.310203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b6d89-0e56-46d8-b071-a0976def86d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:05.311908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b6d89-0e56-46d8-b071-a0976def86d5 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:05.334049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1133/2241] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:05.812744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89231d-99ef-4a81-b8f6-95f99baf6726 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:05.814155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7e89231d-99ef-4a81-b8f6-95f99baf6726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:05.829301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89231d-99ef-4a81-b8f6-95f99baf6726 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:05.835070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:05.836587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:05.837075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:05.837782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] PATH_INFO: `/v3/projects/a482bdffddd34dec9aaa6325a3192770` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:05.839159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a482bdffddd34dec9aaa6325a3192770)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:05.841504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:05.970084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a482bdffddd34dec9aaa6325a3192770', 'request_id': 'req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.063312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a482bdffddd34dec9aaa6325a3192770', 'request_id': 'req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.071283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a482bdffddd34dec9aaa6325a3192770', 'request_id': 'req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.083775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] The token cache is being invalidate because project a482bdffddd34dec9aaa6325a3192770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:12:06.084077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.084776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.090219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1109/2242] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:12:05 2022] DELETE /identity/v3/projects/a482bdffddd34dec9aaa6325a3192770 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:06.091560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6d89-0e56-46d8-b071-a0976def86d5 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:06.102175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6d89-0e56-46d8-b071-a0976def86d5 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:06.160826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:06.161459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:06.161742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:06.162019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] PATH_INFO: `/v3/users/796ef791f83f4940b96465a54ecbce26` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:06.163148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796ef791f83f4940b96465a54ecbce26)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:06.165952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:06.346903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796ef791f83f4940b96465a54ecbce26'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.363821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796ef791f83f4940b96465a54ecbce26'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.372229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796ef791f83f4940b96465a54ecbce26'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.472017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796ef791f83f4940b96465a54ecbce26'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.472694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796ef791f83f4940b96465a54ecbce26'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:06.474375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:06.480300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1134/2243] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:12:06 2022] DELETE /identity/v3/users/796ef791f83f4940b96465a54ecbce26 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:06.907925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:06.909642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:06.925485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f8ca8-22e7-424e-b5fb-e2bef98c7919 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:06.986837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:06.987476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:06.987761 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:06.988179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] PATH_INFO: `/v3/projects/a0e650ffea534ab3bd47b4a460943b18` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:06.989363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e650ffea534ab3bd47b4a460943b18)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:06.992748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:07.009454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:07.128103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e650ffea534ab3bd47b4a460943b18', 'request_id': 'req-2836142e-69b6-4967-9c31-7eb8e0c88b8b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.212348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e650ffea534ab3bd47b4a460943b18', 'request_id': 'req-2836142e-69b6-4967-9c31-7eb8e0c88b8b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.219875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e650ffea534ab3bd47b4a460943b18', 'request_id': 'req-2836142e-69b6-4967-9c31-7eb8e0c88b8b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.234863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] The token cache is being invalidate because project a0e650ffea534ab3bd47b4a460943b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:12:07.235312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.236181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.237947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1110/2244] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:12:06 2022] DELETE /identity/v3/projects/a0e650ffea534ab3bd47b4a460943b18 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:07.242363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:07.243977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:07.257367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5286486-0adb-4308-ba9b-06e8b0cc23f2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:07.316179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:07.316835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:07.317121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:07.317399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] PATH_INFO: `/v3/users/d933db4deb9a45e9924f7a427e26cde7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:07.318521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d933db4deb9a45e9924f7a427e26cde7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:07.321070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:07.543944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd933db4deb9a45e9924f7a427e26cde7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.556712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd933db4deb9a45e9924f7a427e26cde7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.563877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd933db4deb9a45e9924f7a427e26cde7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.675070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd933db4deb9a45e9924f7a427e26cde7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.675661 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fdd7e831-53b8-4669-9e9e-5ed9b822506f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd933db4deb9a45e9924f7a427e26cde7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:07.683014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1135/2245] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:12:07 2022] DELETE /identity/v3/users/d933db4deb9a45e9924f7a427e26cde7 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:08.113660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:08.115132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:08.143249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836142e-69b6-4967-9c31-7eb8e0c88b8b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:08.212332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:08.212940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:08.213220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:08.213493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] PATH_INFO: `/v3/projects/a70063afff524d518244d53f339f3e08` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:08.214796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70063afff524d518244d53f339f3e08)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:08.216731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:08.378873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70063afff524d518244d53f339f3e08', 'request_id': 'req-3e935fd9-22f0-42dd-9356-1205ddcb842e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:08.466260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70063afff524d518244d53f339f3e08', 'request_id': 'req-3e935fd9-22f0-42dd-9356-1205ddcb842e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:08.478902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70063afff524d518244d53f339f3e08', 'request_id': 'req-3e935fd9-22f0-42dd-9356-1205ddcb842e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:08.493596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] The token cache is being invalidate because project a70063afff524d518244d53f339f3e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:12:08.494070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:08.495288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3e935fd9-22f0-42dd-9356-1205ddcb842e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:08.497192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1111/2246] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:12:08 2022] DELETE /identity/v3/projects/a70063afff524d518244d53f339f3e08 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:12:08.504175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f84d6-346a-4f9e-b57a-79c3e5c03c06 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:08.505295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f84d6-346a-4f9e-b57a-79c3e5c03c06 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:08.505768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f84d6-346a-4f9e-b57a-79c3e5c03c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:08.538041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f37f84d6-346a-4f9e-b57a-79c3e5c03c06 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:08.539574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f37f84d6-346a-4f9e-b57a-79c3e5c03c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:08.631259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1136/2247] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:08.639839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e453-beaa-4456-a54b-432ee936ce0b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:08.640130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e453-beaa-4456-a54b-432ee936ce0b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:08.640438 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e453-beaa-4456-a54b-432ee936ce0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:08.660399 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6b53e453-beaa-4456-a54b-432ee936ce0b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:08.661635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6b53e453-beaa-4456-a54b-432ee936ce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:08.669790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1112/2248] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:08.674001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f84d6-346a-4f9e-b57a-79c3e5c03c06 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:08.684787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f84d6-346a-4f9e-b57a-79c3e5c03c06 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:08.689646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:08.690281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:08.693068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:08.693068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:08.693068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:12:08.693068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:08.693473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:08.705705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1137/2249] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:12:08.710038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e453-beaa-4456-a54b-432ee936ce0b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:08.719915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e453-beaa-4456-a54b-432ee936ce0b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:08.724663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e3cf3-3dff-4300-837f-1145ba0b5b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:08.725258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e3cf3-3dff-4300-837f-1145ba0b5b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:08.725811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e3cf3-3dff-4300-837f-1145ba0b5b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:08.726087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e3cf3-3dff-4300-837f-1145ba0b5b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:08.727251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e3cf3-3dff-4300-837f-1145ba0b5b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:08.729277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e3cf3-3dff-4300-837f-1145ba0b5b3e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:08.746242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:08.811025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1113/2250] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:12:08 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:08.814767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:08.822319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:08.826156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faae910-fa7f-4224-9f4d-c0ccc80649df admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:08.883357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba8fe7-81b7-47f9-9385-ac34f705103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:08.883959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8fe7-81b7-47f9-9385-ac34f705103a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:08.884238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8fe7-81b7-47f9-9385-ac34f705103a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:08.884541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8fe7-81b7-47f9-9385-ac34f705103a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:08.885165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba8fe7-81b7-47f9-9385-ac34f705103a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:08.887064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba8fe7-81b7-47f9-9385-ac34f705103a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:08.978231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1138/2251] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:12:08 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:08.982578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e3cf3-3dff-4300-837f-1145ba0b5b3e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:08.993649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e3cf3-3dff-4300-837f-1145ba0b5b3e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:08.998293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac084d-0620-4817-8a4e-da1b7371818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:08.998933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac084d-0620-4817-8a4e-da1b7371818b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:08.999216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac084d-0620-4817-8a4e-da1b7371818b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:08.999488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac084d-0620-4817-8a4e-da1b7371818b admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:09.000121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac084d-0620-4817-8a4e-da1b7371818b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:09.001743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac084d-0620-4817-8a4e-da1b7371818b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:09.011612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1114/2252] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:12:09.015723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba8fe7-81b7-47f9-9385-ac34f705103a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:09.025978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba8fe7-81b7-47f9-9385-ac34f705103a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:09.030687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958dc12-1ade-48c7-9dc0-9bd6c62545b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:09.031287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958dc12-1ade-48c7-9dc0-9bd6c62545b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:09.031572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958dc12-1ade-48c7-9dc0-9bd6c62545b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:09.031846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958dc12-1ade-48c7-9dc0-9bd6c62545b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:09.034880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958dc12-1ade-48c7-9dc0-9bd6c62545b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:09.034880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958dc12-1ade-48c7-9dc0-9bd6c62545b4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:09.045519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1139/2253] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:09.049712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac084d-0620-4817-8a4e-da1b7371818b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:09.060360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac084d-0620-4817-8a4e-da1b7371818b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:09.064997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:09.065643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:09.065926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:09.066200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] PATH_INFO: `/v3/projects/44cfaa7a9ec843e1a26460270f99a9e2/users/c0121ba668034aac98863a2caf80320e/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:09.081260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44cfaa7a9ec843e1a26460270f99a9e2, user_id=c0121ba668034aac98863a2caf80320e, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:09.084012 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:09.181758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1115/2254] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:09 2022] PUT /identity/v3/projects/44cfaa7a9ec843e1a26460270f99a9e2/users/c0121ba668034aac98863a2caf80320e/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:12:09.186801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8819-a3a0-494a-9024-b6e431465b2c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:09.187092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8819-a3a0-494a-9024-b6e431465b2c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:09.187385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8819-a3a0-494a-9024-b6e431465b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:09.207073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-460b8819-a3a0-494a-9024-b6e431465b2c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:09.208301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-460b8819-a3a0-494a-9024-b6e431465b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:09.268676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1140/2255] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:09.278783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:09.282812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:09.336991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7d209-c518-4d0c-b86e-27b43b71198d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:09.340589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbe4cc-1657-4f3e-ae63-46481a6bd28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:09.345296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe4cc-1657-4f3e-ae63-46481a6bd28a service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:09.345296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe4cc-1657-4f3e-ae63-46481a6bd28a service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:09.345296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe4cc-1657-4f3e-ae63-46481a6bd28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:09.352696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbe4cc-1657-4f3e-ae63-46481a6bd28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:09.354233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbe4cc-1657-4f3e-ae63-46481a6bd28a service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:09.363978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1116/2256] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:09.652775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b8819-a3a0-494a-9024-b6e431465b2c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:09.654283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-460b8819-a3a0-494a-9024-b6e431465b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:09.666951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b8819-a3a0-494a-9024-b6e431465b2c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:09.672097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:09.672919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:09.673234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:09.673592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] PATH_INFO: `/v3/users/ed184c26b570476a9f0d0c5a6ec8c27d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:09.674788 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed184c26b570476a9f0d0c5a6ec8c27d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:09.676908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:09.869058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed184c26b570476a9f0d0c5a6ec8c27d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:09.881921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed184c26b570476a9f0d0c5a6ec8c27d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:09.890078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed184c26b570476a9f0d0c5a6ec8c27d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:09.894263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:10.004204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed184c26b570476a9f0d0c5a6ec8c27d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:10.004943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed184c26b570476a9f0d0c5a6ec8c27d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:10.012208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1141/2257] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:12:09 2022] DELETE /identity/v3/users/ed184c26b570476a9f0d0c5a6ec8c27d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:10.016666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d45e-a899-4c19-85ad-342ff1d6bbea None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:10.016957 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d45e-a899-4c19-85ad-342ff1d6bbea None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:10.017236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d45e-a899-4c19-85ad-342ff1d6bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:10.036691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bfd5d45e-a899-4c19-85ad-342ff1d6bbea None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:10.037908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bfd5d45e-a899-4c19-85ad-342ff1d6bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:10.098214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1117/2258] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:10.108523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:10.110507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:10.171876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdf850-4b5d-4498-8d54-07c2318ada07 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:10.175520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6084-a62d-4e6e-93e2-321275a889ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:10.176134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6084-a62d-4e6e-93e2-321275a889ee service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:10.176421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6084-a62d-4e6e-93e2-321275a889ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:10.176735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6084-a62d-4e6e-93e2-321275a889ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:10.189497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6084-a62d-4e6e-93e2-321275a889ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:10.191220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6084-a62d-4e6e-93e2-321275a889ee service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:10.203379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1142/2259] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:10.749552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5d45e-a899-4c19-85ad-342ff1d6bbea None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:10.755324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bfd5d45e-a899-4c19-85ad-342ff1d6bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:10.768904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5d45e-a899-4c19-85ad-342ff1d6bbea None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:10.775434 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:10.776198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:10.776913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:10.777407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] PATH_INFO: `/v3/projects/95cf69324c994650ae4dd4c2cfb6bd02` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:10.779163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cf69324c994650ae4dd4c2cfb6bd02)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:10.782069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:10.890310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cf69324c994650ae4dd4c2cfb6bd02', 'request_id': 'req-aae75a03-f395-4772-bd06-fe81c0e7cb87'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:10.947117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cf69324c994650ae4dd4c2cfb6bd02', 'request_id': 'req-aae75a03-f395-4772-bd06-fe81c0e7cb87'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:10.949527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:10.955096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cf69324c994650ae4dd4c2cfb6bd02', 'request_id': 'req-aae75a03-f395-4772-bd06-fe81c0e7cb87'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:10.968017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] The token cache is being invalidate because project 95cf69324c994650ae4dd4c2cfb6bd02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:12:10.968316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:10.969010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-aae75a03-f395-4772-bd06-fe81c0e7cb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:10.970878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1118/2260] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:12:10 2022] DELETE /identity/v3/projects/95cf69324c994650ae4dd4c2cfb6bd02 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:10.975970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd324d-716b-4527-89f4-bcae586e17d6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:10.976543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd324d-716b-4527-89f4-bcae586e17d6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:10.976834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd324d-716b-4527-89f4-bcae586e17d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:10.999227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-65fd324d-716b-4527-89f4-bcae586e17d6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:11.000871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-65fd324d-716b-4527-89f4-bcae586e17d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:11.064117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1143/2261] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:11.072630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b44d-510f-484d-9f24-c61c467b3986 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:11.076662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b44d-510f-484d-9f24-c61c467b3986 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:11.076997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094b44d-510f-484d-9f24-c61c467b3986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:11.114455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b094b44d-510f-484d-9f24-c61c467b3986 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:11.115754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b094b44d-510f-484d-9f24-c61c467b3986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:11.130952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1119/2262] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:12:11.133893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd324d-716b-4527-89f4-bcae586e17d6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:11.144190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd324d-716b-4527-89f4-bcae586e17d6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:11.150158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:11.150806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:11.151087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:11.151363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:11.152051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:12:11.152357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:11.154078 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:11.166411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1144/2263] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:12:11.170660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b44d-510f-484d-9f24-c61c467b3986 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:11.179876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094b44d-510f-484d-9f24-c61c467b3986 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:11.184814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf8058-10b6-41af-b7cc-37f68aab5a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:11.185416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8058-10b6-41af-b7cc-37f68aab5a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:11.185698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8058-10b6-41af-b7cc-37f68aab5a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:11.185964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8058-10b6-41af-b7cc-37f68aab5a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:11.186603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf8058-10b6-41af-b7cc-37f68aab5a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:11.188501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf8058-10b6-41af-b7cc-37f68aab5a7d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:11.302664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1120/2264] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:12:11 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:11.307628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:11.318165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2ad5-146e-4475-a828-be711bd49117 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:11.386619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4eb65-26a5-4c0e-ac02-e2b655cbc59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:11.387244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4eb65-26a5-4c0e-ac02-e2b655cbc59a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:11.387534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4eb65-26a5-4c0e-ac02-e2b655cbc59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:11.387814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4eb65-26a5-4c0e-ac02-e2b655cbc59a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:11.388468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4eb65-26a5-4c0e-ac02-e2b655cbc59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:11.390482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4eb65-26a5-4c0e-ac02-e2b655cbc59a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:11.483104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1145/2265] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:12:11 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:11.484362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf8058-10b6-41af-b7cc-37f68aab5a7d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:11.495429 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf8058-10b6-41af-b7cc-37f68aab5a7d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:11.500778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33b26e-889c-4152-82a2-ea8a996c2ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:11.501646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b26e-889c-4152-82a2-ea8a996c2ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:11.504548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b26e-889c-4152-82a2-ea8a996c2ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:11.504548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b26e-889c-4152-82a2-ea8a996c2ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:11.504548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33b26e-889c-4152-82a2-ea8a996c2ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:11.505302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33b26e-889c-4152-82a2-ea8a996c2ed8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:11.517584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1121/2266] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:11.522611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4eb65-26a5-4c0e-ac02-e2b655cbc59a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:11.545061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4eb65-26a5-4c0e-ac02-e2b655cbc59a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:11.551533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b1fd0-e693-4b01-9484-f9600310c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:11.552168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1fd0-e693-4b01-9484-f9600310c2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:11.552453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1fd0-e693-4b01-9484-f9600310c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:11.552775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1fd0-e693-4b01-9484-f9600310c2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:11.553702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b1fd0-e693-4b01-9484-f9600310c2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:11.555248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b1fd0-e693-4b01-9484-f9600310c2c1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:11.567252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1146/2267] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:11.572039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33b26e-889c-4152-82a2-ea8a996c2ed8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:11.586403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33b26e-889c-4152-82a2-ea8a996c2ed8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:11.592784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b599d5-e6b3-401e-a8ed-22684bb54765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:11.593109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b599d5-e6b3-401e-a8ed-22684bb54765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:11.593977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b599d5-e6b3-401e-a8ed-22684bb54765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:11.594260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b599d5-e6b3-401e-a8ed-22684bb54765 admin admin] PATH_INFO: `/v3/projects/0cdd3894d401434faf755031bfacbdc2/users/c7eb258880354e8d8cff1a2e6c852882/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:11.610713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b599d5-e6b3-401e-a8ed-22684bb54765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdd3894d401434faf755031bfacbdc2, user_id=c7eb258880354e8d8cff1a2e6c852882, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:11.613388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b599d5-e6b3-401e-a8ed-22684bb54765 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:11.739367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1122/2268] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:11 2022] PUT /identity/v3/projects/0cdd3894d401434faf755031bfacbdc2/users/c7eb258880354e8d8cff1a2e6c852882/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:11.744337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62154ec-a059-4434-bb34-bd602f72fff3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:11.745017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62154ec-a059-4434-bb34-bd602f72fff3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:11.746495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62154ec-a059-4434-bb34-bd602f72fff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:11.771112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:11.809235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c62154ec-a059-4434-bb34-bd602f72fff3 None None] MFA Rules not processed for user `c7eb258880354e8d8cff1a2e6c852882`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:11.810923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c62154ec-a059-4434-bb34-bd602f72fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:11.914144 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1147/2269] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:11.919353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b599d5-e6b3-401e-a8ed-22684bb54765 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:12.031818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b599d5-e6b3-401e-a8ed-22684bb54765 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:12.037286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40c6ac-04e7-4c81-91b4-bd2945bb81cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:12.038209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c6ac-04e7-4c81-91b4-bd2945bb81cb admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:12.038676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c6ac-04e7-4c81-91b4-bd2945bb81cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:12.039203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40c6ac-04e7-4c81-91b4-bd2945bb81cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:12.040303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40c6ac-04e7-4c81-91b4-bd2945bb81cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:12.042573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40c6ac-04e7-4c81-91b4-bd2945bb81cb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:12.158986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1123/2270] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:12:11 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:12.162985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62154ec-a059-4434-bb34-bd602f72fff3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:12.183142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62154ec-a059-4434-bb34-bd602f72fff3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:12.246279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedf45f-b379-4f3d-aacf-761c4c3dcddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:12.247033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf45f-b379-4f3d-aacf-761c4c3dcddc admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:12.247420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf45f-b379-4f3d-aacf-761c4c3dcddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:12.247814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf45f-b379-4f3d-aacf-761c4c3dcddc admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:12.248875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedf45f-b379-4f3d-aacf-761c4c3dcddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:12.251574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedf45f-b379-4f3d-aacf-761c4c3dcddc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:12.351199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1148/2271] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:12:12 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:12.354758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40c6ac-04e7-4c81-91b4-bd2945bb81cb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:12.367571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40c6ac-04e7-4c81-91b4-bd2945bb81cb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:12.376405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9c365-505e-483d-857f-0171cc7918d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:12.377217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c365-505e-483d-857f-0171cc7918d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:12.382464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c365-505e-483d-857f-0171cc7918d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:12.382464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c365-505e-483d-857f-0171cc7918d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:12.382464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9c365-505e-483d-857f-0171cc7918d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:12.382464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9c365-505e-483d-857f-0171cc7918d3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:12.395466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1124/2272] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:12.399452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedf45f-b379-4f3d-aacf-761c4c3dcddc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:12.412021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedf45f-b379-4f3d-aacf-761c4c3dcddc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:12.420003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15389b2-3816-498f-8651-69a5f7e52c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:12.420670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15389b2-3816-498f-8651-69a5f7e52c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:12.420958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15389b2-3816-498f-8651-69a5f7e52c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:12.422103 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15389b2-3816-498f-8651-69a5f7e52c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:12.423150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15389b2-3816-498f-8651-69a5f7e52c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:12.424833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15389b2-3816-498f-8651-69a5f7e52c1c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:12.444658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1149/2273] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:12.449893 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9c365-505e-483d-857f-0171cc7918d3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:12.462876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9c365-505e-483d-857f-0171cc7918d3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:12.469139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf922dc8-934e-4e6b-acce-76211b07e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:12.469990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf922dc8-934e-4e6b-acce-76211b07e8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:12.471290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf922dc8-934e-4e6b-acce-76211b07e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:12.471596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf922dc8-934e-4e6b-acce-76211b07e8a0 admin admin] PATH_INFO: `/v3/projects/90586be7270f474a8c802926eb934c07/users/bd76c78b0c3446aea78d96f1908b4af5/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:12.502738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf922dc8-934e-4e6b-acce-76211b07e8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90586be7270f474a8c802926eb934c07, user_id=bd76c78b0c3446aea78d96f1908b4af5, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:12.502738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf922dc8-934e-4e6b-acce-76211b07e8a0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:12.625800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1125/2274] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:12 2022] PUT /identity/v3/projects/90586be7270f474a8c802926eb934c07/users/bd76c78b0c3446aea78d96f1908b4af5/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:12:12.637326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0b14-bf7c-4754-aff4-8079df2b3b0a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:12.637675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0b14-bf7c-4754-aff4-8079df2b3b0a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:12.637955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0b14-bf7c-4754-aff4-8079df2b3b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:12.677916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9f0c0b14-bf7c-4754-aff4-8079df2b3b0a None None] MFA Rules not processed for user `bd76c78b0c3446aea78d96f1908b4af5`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:12.679624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9f0c0b14-bf7c-4754-aff4-8079df2b3b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:12.824296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf922dc8-934e-4e6b-acce-76211b07e8a0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:12.825327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1150/2275] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:12:12.875289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:12.907906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf922dc8-934e-4e6b-acce-76211b07e8a0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:12.913081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69419bbe-cbca-4362-b64f-9999b3c6b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:12.913372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419bbe-cbca-4362-b64f-9999b3c6b7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:12.913651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419bbe-cbca-4362-b64f-9999b3c6b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:12.913987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419bbe-cbca-4362-b64f-9999b3c6b7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:12.914792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69419bbe-cbca-4362-b64f-9999b3c6b7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:12.916846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69419bbe-cbca-4362-b64f-9999b3c6b7e3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:13.006062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1126/2276] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:12:12 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:12:13.010091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c0b14-bf7c-4754-aff4-8079df2b3b0a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:13.016559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:13.022710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c0b14-bf7c-4754-aff4-8079df2b3b0a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:13.147291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407bcc0-59d5-43f2-bd8e-8d8227d315ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:13.147983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407bcc0-59d5-43f2-bd8e-8d8227d315ce admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:13.148995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407bcc0-59d5-43f2-bd8e-8d8227d315ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:13.149279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407bcc0-59d5-43f2-bd8e-8d8227d315ce admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:13.150008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407bcc0-59d5-43f2-bd8e-8d8227d315ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:13.152091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407bcc0-59d5-43f2-bd8e-8d8227d315ce admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:13.260092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1151/2277] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:12:13 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:13.264090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69419bbe-cbca-4362-b64f-9999b3c6b7e3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:13.279921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69419bbe-cbca-4362-b64f-9999b3c6b7e3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:13.285713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c4448-a62e-4ab1-8260-ea0d889cbd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:13.286570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4448-a62e-4ab1-8260-ea0d889cbd02 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:13.286848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4448-a62e-4ab1-8260-ea0d889cbd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:13.287119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4448-a62e-4ab1-8260-ea0d889cbd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:13.287772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c4448-a62e-4ab1-8260-ea0d889cbd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:13.290510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c4448-a62e-4ab1-8260-ea0d889cbd02 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:13.303258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1127/2278] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:12:13.307748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407bcc0-59d5-43f2-bd8e-8d8227d315ce admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:13.319297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407bcc0-59d5-43f2-bd8e-8d8227d315ce admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:13.337392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b93df-7d5b-470f-b3ff-e8caa14dbd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:13.338807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b93df-7d5b-470f-b3ff-e8caa14dbd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:13.339105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b93df-7d5b-470f-b3ff-e8caa14dbd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:13.339391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b93df-7d5b-470f-b3ff-e8caa14dbd3c admin admin] PATH_INFO: `/v3/projects/563c98e2948045fc8965dac5302cb693/users/727906fa16f74ea097f655eadfac24e7/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:13.362951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b93df-7d5b-470f-b3ff-e8caa14dbd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=563c98e2948045fc8965dac5302cb693, user_id=727906fa16f74ea097f655eadfac24e7, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:13.365980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b93df-7d5b-470f-b3ff-e8caa14dbd3c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:13.432630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1152/2279] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:13 2022] PUT /identity/v3/projects/563c98e2948045fc8965dac5302cb693/users/727906fa16f74ea097f655eadfac24e7/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:12:13.439256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c4448-a62e-4ab1-8260-ea0d889cbd02 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:13.449005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c4448-a62e-4ab1-8260-ea0d889cbd02 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:13.519615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45abd7-ee39-455a-b10c-47beab27c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:13.520239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45abd7-ee39-455a-b10c-47beab27c6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:13.520574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45abd7-ee39-455a-b10c-47beab27c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:13.520858 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45abd7-ee39-455a-b10c-47beab27c6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:13.521508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45abd7-ee39-455a-b10c-47beab27c6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:13.523104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45abd7-ee39-455a-b10c-47beab27c6dd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:13.542901 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1128/2280] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:13.543122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b93df-7d5b-470f-b3ff-e8caa14dbd3c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:13.550965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b93df-7d5b-470f-b3ff-e8caa14dbd3c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:13.556201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:13.556951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:13.557482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:13.558045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] PATH_INFO: `/v3/projects/563c98e2948045fc8965dac5302cb693/users/727906fa16f74ea097f655eadfac24e7/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:13.560871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=563c98e2948045fc8965dac5302cb693, user_id=727906fa16f74ea097f655eadfac24e7, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:13.563694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:13.576581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1153/2281] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:13 2022] PUT /identity/v3/projects/563c98e2948045fc8965dac5302cb693/users/727906fa16f74ea097f655eadfac24e7/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:13.587046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3fc2d-e074-4c8a-877e-c748f231063f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:13.587191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3fc2d-e074-4c8a-877e-c748f231063f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:13.588800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3fc2d-e074-4c8a-877e-c748f231063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:13.622574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ccb3fc2d-e074-4c8a-877e-c748f231063f None None] MFA Rules not processed for user `727906fa16f74ea097f655eadfac24e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:13.622815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ccb3fc2d-e074-4c8a-877e-c748f231063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:13.707200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1129/2282] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:13.720040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:13.721903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:13.794915 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc78f-3170-4d75-8f01-049f7b84e0ef admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:13.798850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:13.799539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:13.799890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:13.800229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:13.881644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:13.883910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:13.894866 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1154/2283] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:15.354402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1256-d32d-4dcb-a987-9a0bf164074b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:15.354859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1256-d32d-4dcb-a987-9a0bf164074b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:15.354965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf1256-d32d-4dcb-a987-9a0bf164074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:15.391175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d6bf1256-d32d-4dcb-a987-9a0bf164074b None None] MFA Rules not processed for user `c0121ba668034aac98863a2caf80320e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:15.392408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d6bf1256-d32d-4dcb-a987-9a0bf164074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:15.410936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:15.466059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1130/2284] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:15.480427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:15.485722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:15.499414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:15.586637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc4813-8d77-47d7-9690-928f706da4d6 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:15.596776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e52f4-bcf2-4050-9634-b9039f7993d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:15.599401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e52f4-bcf2-4050-9634-b9039f7993d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:15.599705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e52f4-bcf2-4050-9634-b9039f7993d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:15.599986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e52f4-bcf2-4050-9634-b9039f7993d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:15.601019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e52f4-bcf2-4050-9634-b9039f7993d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:15.603788 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e52f4-bcf2-4050-9634-b9039f7993d2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:15.735246 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1155/2285] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:12:15 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:15.739194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf1256-d32d-4dcb-a987-9a0bf164074b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:15.751355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf1256-d32d-4dcb-a987-9a0bf164074b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:15.817260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74101c28-46dd-42f7-b120-400ee8324b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:15.818014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74101c28-46dd-42f7-b120-400ee8324b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:15.818394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74101c28-46dd-42f7-b120-400ee8324b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:15.818889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74101c28-46dd-42f7-b120-400ee8324b81 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:15.819809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74101c28-46dd-42f7-b120-400ee8324b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:15.821948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74101c28-46dd-42f7-b120-400ee8324b81 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:15.945984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1131/2286] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:12:15 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:15.950168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e52f4-bcf2-4050-9634-b9039f7993d2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:15.966688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e52f4-bcf2-4050-9634-b9039f7993d2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:15.979876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa30d1-9040-49e4-9b6d-af69c588747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:15.980518 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa30d1-9040-49e4-9b6d-af69c588747c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:15.980802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa30d1-9040-49e4-9b6d-af69c588747c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:15.981074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa30d1-9040-49e4-9b6d-af69c588747c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:15.981744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa30d1-9040-49e4-9b6d-af69c588747c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:15.983541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa30d1-9040-49e4-9b6d-af69c588747c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:15.998303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1156/2287] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:16.002503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74101c28-46dd-42f7-b120-400ee8324b81 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:16.015246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74101c28-46dd-42f7-b120-400ee8324b81 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:16.022429 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c8f6f-9337-48f4-a626-361b5de32391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:16.023973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c8f6f-9337-48f4-a626-361b5de32391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:16.024603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c8f6f-9337-48f4-a626-361b5de32391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:16.028947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c8f6f-9337-48f4-a626-361b5de32391 admin admin] PATH_INFO: `/v3/projects/085ba2d5f6734aadb838521895b82ec6/users/823d8a02fd004fd78f2e7c0cf2981fd4/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:16.041521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c8f6f-9337-48f4-a626-361b5de32391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085ba2d5f6734aadb838521895b82ec6, user_id=823d8a02fd004fd78f2e7c0cf2981fd4, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:16.045280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c8f6f-9337-48f4-a626-361b5de32391 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:16.149537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1132/2288] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:16 2022] PUT /identity/v3/projects/085ba2d5f6734aadb838521895b82ec6/users/823d8a02fd004fd78f2e7c0cf2981fd4/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:16.153724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa30d1-9040-49e4-9b6d-af69c588747c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:16.163762 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa30d1-9040-49e4-9b6d-af69c588747c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:16.226015 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:16.226858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:16.227143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:16.227565 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:16.228255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:16.230017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:16.240580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1157/2289] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:16.245475 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c8f6f-9337-48f4-a626-361b5de32391 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:16.256501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c8f6f-9337-48f4-a626-361b5de32391 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:16.262241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e5f20-a244-41a8-9fb1-22dafede3fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:16.264056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5f20-a244-41a8-9fb1-22dafede3fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:16.264056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5f20-a244-41a8-9fb1-22dafede3fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:16.264056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5f20-a244-41a8-9fb1-22dafede3fe0 admin admin] PATH_INFO: `/v3/projects/085ba2d5f6734aadb838521895b82ec6/users/823d8a02fd004fd78f2e7c0cf2981fd4/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:16.265497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e5f20-a244-41a8-9fb1-22dafede3fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085ba2d5f6734aadb838521895b82ec6, user_id=823d8a02fd004fd78f2e7c0cf2981fd4, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:16.268134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e5f20-a244-41a8-9fb1-22dafede3fe0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:16.279188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1133/2290] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:16 2022] PUT /identity/v3/projects/085ba2d5f6734aadb838521895b82ec6/users/823d8a02fd004fd78f2e7c0cf2981fd4/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:17.182159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:17.184142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:17.258775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61da1-e341-475c-8851-e3955047dbef admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:17.296414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:17.314850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e588bb-2e83-461c-a064-2a814f98a86d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:17.316829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e588bb-2e83-461c-a064-2a814f98a86d service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:17.316829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e588bb-2e83-461c-a064-2a814f98a86d service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:17.316829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e588bb-2e83-461c-a064-2a814f98a86d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:17.378473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e588bb-2e83-461c-a064-2a814f98a86d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:17.379969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e588bb-2e83-461c-a064-2a814f98a86d service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:17.390435 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1158/2291] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:19.334915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e5f20-a244-41a8-9fb1-22dafede3fe0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:19.357889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e5f20-a244-41a8-9fb1-22dafede3fe0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:19.363854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:19.365851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:19.366376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:19.368266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:19.483283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:19.484989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:19.505389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1134/2292] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:23.672875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd022-f115-46ba-aebb-478aac68f1d0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:23.673380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd022-f115-46ba-aebb-478aac68f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:23.673479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd022-f115-46ba-aebb-478aac68f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:23.703400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f04cd022-f115-46ba-aebb-478aac68f1d0 None None] MFA Rules not processed for user `823d8a02fd004fd78f2e7c0cf2981fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:23.704623 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f04cd022-f115-46ba-aebb-478aac68f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:23.785543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1159/2293] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:23.802249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:23.804190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:23.816722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:23.892733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee703-a226-4713-9d1a-5f4a342b9da9 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:23.899085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bfcea-9ebb-4acb-a9b5-eb289d158032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:23.899621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bfcea-9ebb-4acb-a9b5-eb289d158032 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:23.899906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bfcea-9ebb-4acb-a9b5-eb289d158032 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:23.900190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bfcea-9ebb-4acb-a9b5-eb289d158032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:23.954581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bfcea-9ebb-4acb-a9b5-eb289d158032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:23.956173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bfcea-9ebb-4acb-a9b5-eb289d158032 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:23.965769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1135/2294] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:26.537234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cd022-f115-46ba-aebb-478aac68f1d0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:26.610066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cd022-f115-46ba-aebb-478aac68f1d0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:26.615287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:26.615972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:26.616186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:26.616459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] PATH_INFO: `/v3/users/c7eb258880354e8d8cff1a2e6c852882` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:26.618164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eb258880354e8d8cff1a2e6c852882)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:26.620133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:26.640127 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:26.873676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eb258880354e8d8cff1a2e6c852882'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:26.912521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eb258880354e8d8cff1a2e6c852882'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:26.931067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eb258880354e8d8cff1a2e6c852882'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:27.021664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eb258880354e8d8cff1a2e6c852882'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:27.022428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eb258880354e8d8cff1a2e6c852882'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:27.033790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1160/2295] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:12:26 2022] DELETE /identity/v3/users/c7eb258880354e8d8cff1a2e6c852882 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:27.038323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055975a0-c1e9-4c97-891b-72791d6c1ffd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:27.038768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055975a0-c1e9-4c97-891b-72791d6c1ffd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:27.038768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055975a0-c1e9-4c97-891b-72791d6c1ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:27.068958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-055975a0-c1e9-4c97-891b-72791d6c1ffd None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:27.071392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-055975a0-c1e9-4c97-891b-72791d6c1ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:27.191812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1136/2296] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:27.203718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:27.205365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:27.281869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b931-ea55-4e87-a285-0b598a0cf6f7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:27.285776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f80a7-f2e4-4671-ac46-2e3d34f0c2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:27.286460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f80a7-f2e4-4671-ac46-2e3d34f0c2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:27.286804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f80a7-f2e4-4671-ac46-2e3d34f0c2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:27.287146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f80a7-f2e4-4671-ac46-2e3d34f0c2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:27.297700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f80a7-f2e4-4671-ac46-2e3d34f0c2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:27.299302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f80a7-f2e4-4671-ac46-2e3d34f0c2f8 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:27.312698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1161/2297] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:28.076509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055975a0-c1e9-4c97-891b-72791d6c1ffd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:28.077952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-055975a0-c1e9-4c97-891b-72791d6c1ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:28.091603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055975a0-c1e9-4c97-891b-72791d6c1ffd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:28.097228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:28.098212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:28.098511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:28.098809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] PATH_INFO: `/v3/projects/0cdd3894d401434faf755031bfacbdc2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:28.100283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdd3894d401434faf755031bfacbdc2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:28.102822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:28.262488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:28.271673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdd3894d401434faf755031bfacbdc2', 'request_id': 'req-42316efd-1e83-4db8-9044-cead4b04eed9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.349087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdd3894d401434faf755031bfacbdc2', 'request_id': 'req-42316efd-1e83-4db8-9044-cead4b04eed9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.363751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdd3894d401434faf755031bfacbdc2', 'request_id': 'req-42316efd-1e83-4db8-9044-cead4b04eed9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.376417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] The token cache is being invalidate because project 0cdd3894d401434faf755031bfacbdc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:12:28.376930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.377765 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.379812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1137/2298] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:12:28 2022] DELETE /identity/v3/projects/0cdd3894d401434faf755031bfacbdc2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:28.384685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f80a7-f2e4-4671-ac46-2e3d34f0c2f8 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:28.396429 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f80a7-f2e4-4671-ac46-2e3d34f0c2f8 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:28.471381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:28.471381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:28.471782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:28.471880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] PATH_INFO: `/v3/users/bd76c78b0c3446aea78d96f1908b4af5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:28.473036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd76c78b0c3446aea78d96f1908b4af5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:28.475001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:28.646760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:28.653765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd76c78b0c3446aea78d96f1908b4af5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.666852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd76c78b0c3446aea78d96f1908b4af5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.681629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd76c78b0c3446aea78d96f1908b4af5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.734908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd76c78b0c3446aea78d96f1908b4af5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.735605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd76c78b0c3446aea78d96f1908b4af5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:28.749101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1162/2299] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:12:28 2022] DELETE /identity/v3/users/bd76c78b0c3446aea78d96f1908b4af5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:29.245996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:29.248000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:29.261868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42316efd-1e83-4db8-9044-cead4b04eed9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:29.319551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:29.320727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:29.321014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:29.321308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] PATH_INFO: `/v3/projects/90586be7270f474a8c802926eb934c07` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:29.322425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90586be7270f474a8c802926eb934c07)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:29.324339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:29.483765 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90586be7270f474a8c802926eb934c07', 'request_id': 'req-73a1a930-1690-4077-b21f-225d838adc99'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:29.609208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90586be7270f474a8c802926eb934c07', 'request_id': 'req-73a1a930-1690-4077-b21f-225d838adc99'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:29.616204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90586be7270f474a8c802926eb934c07', 'request_id': 'req-73a1a930-1690-4077-b21f-225d838adc99'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:29.629079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] The token cache is being invalidate because project 90586be7270f474a8c802926eb934c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:12:29.629464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:29.630034 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:29.631592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1138/2300] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:12:29 2022] DELETE /identity/v3/projects/90586be7270f474a8c802926eb934c07 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:29.636408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:29.641874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:29.652017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515664-f849-4bc3-9ed5-ae4c1c2aef41 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:29.727129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:29.733867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:29.733867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:29.733867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] PATH_INFO: `/v3/users/727906fa16f74ea097f655eadfac24e7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:29.733867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=727906fa16f74ea097f655eadfac24e7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:29.733867 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:29.944673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727906fa16f74ea097f655eadfac24e7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:29.958155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727906fa16f74ea097f655eadfac24e7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:29.966353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727906fa16f74ea097f655eadfac24e7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:30.066600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727906fa16f74ea097f655eadfac24e7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:30.067320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f03d9e91-f2c0-46ad-9ff0-2556293dd994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727906fa16f74ea097f655eadfac24e7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:30.074369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1163/2301] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:12:29 2022] DELETE /identity/v3/users/727906fa16f74ea097f655eadfac24e7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:30.526224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:30.527728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:30.564250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1a930-1690-4077-b21f-225d838adc99 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:30.625353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:30.633287 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:30.633942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:30.634222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:30.634545 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] PATH_INFO: `/v3/projects/563c98e2948045fc8965dac5302cb693` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:30.636877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=563c98e2948045fc8965dac5302cb693)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:30.638821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:30.808398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563c98e2948045fc8965dac5302cb693', 'request_id': 'req-81f49af6-1861-43b2-944a-26e239a8e90f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:30.880513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563c98e2948045fc8965dac5302cb693', 'request_id': 'req-81f49af6-1861-43b2-944a-26e239a8e90f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:30.887417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563c98e2948045fc8965dac5302cb693', 'request_id': 'req-81f49af6-1861-43b2-944a-26e239a8e90f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:30.898138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] The token cache is being invalidate because project 563c98e2948045fc8965dac5302cb693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:12:30.898609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:30.899335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81f49af6-1861-43b2-944a-26e239a8e90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:12:30.900891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1139/2302] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:12:30 2022] DELETE /identity/v3/projects/563c98e2948045fc8965dac5302cb693 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:12:30.908431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9cd9b-d190-485e-ba47-c8a1badf8952 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:30.911654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9cd9b-d190-485e-ba47-c8a1badf8952 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:30.911654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9cd9b-d190-485e-ba47-c8a1badf8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:30.932357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-47f9cd9b-d190-485e-ba47-c8a1badf8952 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:30.937066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47f9cd9b-d190-485e-ba47-c8a1badf8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:30.974069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:31.005903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1164/2303] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:31.014006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64c3f-93bb-4c79-8e2b-f8be6ce6a991 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.014286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64c3f-93bb-4c79-8e2b-f8be6ce6a991 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.014555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64c3f-93bb-4c79-8e2b-f8be6ce6a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.036597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d1e64c3f-93bb-4c79-8e2b-f8be6ce6a991 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:31.044930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d1e64c3f-93bb-4c79-8e2b-f8be6ce6a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:31.049987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1140/2304] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:31.054834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9cd9b-d190-485e-ba47-c8a1badf8952 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:31.086272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9cd9b-d190-485e-ba47-c8a1badf8952 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:31.091522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:31.092331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.092746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.093111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.095226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:12:31.095544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:31.097229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:31.113718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1165/2305] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:12:31.117394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64c3f-93bb-4c79-8e2b-f8be6ce6a991 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:31.138647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64c3f-93bb-4c79-8e2b-f8be6ce6a991 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:31.145498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c8ee3-a3f2-41e0-a02d-9aeef87ce1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:31.146482 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c8ee3-a3f2-41e0-a02d-9aeef87ce1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.147068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c8ee3-a3f2-41e0-a02d-9aeef87ce1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.147664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c8ee3-a3f2-41e0-a02d-9aeef87ce1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.149109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c8ee3-a3f2-41e0-a02d-9aeef87ce1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:31.151321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c8ee3-a3f2-41e0-a02d-9aeef87ce1a8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:31.269967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1141/2306] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:12:31 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:31.274501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:31.284848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef6454-0a90-4e01-8c7b-e8eb6ca8b45d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:31.344984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c718e-d843-4ab1-a6bb-e5c1b6185ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:31.345843 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c718e-d843-4ab1-a6bb-e5c1b6185ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.346127 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c718e-d843-4ab1-a6bb-e5c1b6185ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.346409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c718e-d843-4ab1-a6bb-e5c1b6185ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.347047 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c718e-d843-4ab1-a6bb-e5c1b6185ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:31.349035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c718e-d843-4ab1-a6bb-e5c1b6185ed1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:31.524958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1166/2307] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:12:31 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:12:31.529230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c8ee3-a3f2-41e0-a02d-9aeef87ce1a8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:31.539773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c8ee3-a3f2-41e0-a02d-9aeef87ce1a8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:31.544303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e1152-ae7d-443e-8f47-5b99d0385d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:31.544970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1152-ae7d-443e-8f47-5b99d0385d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.545315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1152-ae7d-443e-8f47-5b99d0385d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.545487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1152-ae7d-443e-8f47-5b99d0385d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.546118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e1152-ae7d-443e-8f47-5b99d0385d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:31.547686 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e1152-ae7d-443e-8f47-5b99d0385d09 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:31.557943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1142/2308] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:31.561863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c718e-d843-4ab1-a6bb-e5c1b6185ed1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:31.572249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c718e-d843-4ab1-a6bb-e5c1b6185ed1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:31.577907 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d9d1d-8543-4fd1-b169-f9051fa66b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:31.584386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d9d1d-8543-4fd1-b169-f9051fa66b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.584386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d9d1d-8543-4fd1-b169-f9051fa66b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.584386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d9d1d-8543-4fd1-b169-f9051fa66b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.584386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d9d1d-8543-4fd1-b169-f9051fa66b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:31.584386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d9d1d-8543-4fd1-b169-f9051fa66b3f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:31.593973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1167/2309] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:12:31.598223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e1152-ae7d-443e-8f47-5b99d0385d09 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:31.608795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e1152-ae7d-443e-8f47-5b99d0385d09 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:31.613822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:31.614565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.614935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.615213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] PATH_INFO: `/v3/projects/7dc49614c62441aba065fe6b5853eda3/users/a00998ec0bb54534a8751b1efd3025a8/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.632069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc49614c62441aba065fe6b5853eda3, user_id=a00998ec0bb54534a8751b1efd3025a8, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:31.635360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:31.738972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1143/2310] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:12:31 2022] PUT /identity/v3/projects/7dc49614c62441aba065fe6b5853eda3/users/a00998ec0bb54534a8751b1efd3025a8/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:12:31.749992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb8929-38aa-46c1-b6ed-b5a720ca6aa5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.750294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb8929-38aa-46c1-b6ed-b5a720ca6aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.750548 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb8929-38aa-46c1-b6ed-b5a720ca6aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.786254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-daeb8929-38aa-46c1-b6ed-b5a720ca6aa5 None None] MFA Rules not processed for user `a00998ec0bb54534a8751b1efd3025a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:31.787785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-daeb8929-38aa-46c1-b6ed-b5a720ca6aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:31.857228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1168/2311] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:12:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:31.869762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:31.871746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:31.932080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661a237-8acb-4cd1-813b-24fdaf45d340 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:31.936117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f1504-e489-49de-b1b2-6a57ac190185 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa1d30decad84c7081c7e150812b2964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:31.937808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f1504-e489-49de-b1b2-6a57ac190185 service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:31.938160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f1504-e489-49de-b1b2-6a57ac190185 service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:31.938506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f1504-e489-49de-b1b2-6a57ac190185 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:31.948421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f1504-e489-49de-b1b2-6a57ac190185 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:31.950141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f1504-e489-49de-b1b2-6a57ac190185 service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:31.960143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1144/2312] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:12:41.853269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:41.955930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:51.735431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095e3e3-1311-49af-a4ab-6588afa010f9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:51.735827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095e3e3-1311-49af-a4ab-6588afa010f9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:51.735916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095e3e3-1311-49af-a4ab-6588afa010f9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:51.737559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1169/2313] 10.222.0.75 () {54 vars in 961 bytes} [Mon Sep 19 15:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:12:51.743134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0c5ae-d85d-4c00-8952-6e272ceeeba7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:51.743594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0c5ae-d85d-4c00-8952-6e272ceeeba7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:51.743861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0c5ae-d85d-4c00-8952-6e272ceeeba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:51.770730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2bf0c5ae-d85d-4c00-8952-6e272ceeeba7 None None] MFA Rules not processed for user `9e921d9249fb49d4ad9c94caa6691a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:12:51.771867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2bf0c5ae-d85d-4c00-8952-6e272ceeeba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:51.840771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1145/2314] 10.222.0.75 () {58 vars in 1058 bytes} [Mon Sep 19 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:12:51.848616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095e3e3-1311-49af-a4ab-6588afa010f9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:12:51.862472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095e3e3-1311-49af-a4ab-6588afa010f9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:12:51.867448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:12:51.868046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:12:51.868349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:12:51.868648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:12:51.870390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:12:51.883506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:12:51.885145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:12:51.896354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1170/2315] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:13:01.831856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=29 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:01.891860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:17.694871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ade59-560a-47bd-9962-e46c10cd16dc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:13:17.695394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ade59-560a-47bd-9962-e46c10cd16dc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:13:17.695643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ade59-560a-47bd-9962-e46c10cd16dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:13:17.715881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b76ade59-560a-47bd-9962-e46c10cd16dc None None] MFA Rules not processed for user `c0121ba668034aac98863a2caf80320e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:13:17.717093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b76ade59-560a-47bd-9962-e46c10cd16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:13:17.779533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1146/2316] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:13:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:13:19.251852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:13:19.254540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:13:19.309960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3adb-6a49-44f9-b1b5-5cfdfc203c64 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:13:19.313532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:13:19.314191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:13:19.314564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:13:19.314838 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:13:19.316598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:13:19.391345 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:13:19.393013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:13:19.404414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1171/2317] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:13:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:13:27.766948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=25 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:29.398868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=50 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:49.694323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efb6ee-7c89-43b4-b2c4-cadcbbb4319e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:13:49.694837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efb6ee-7c89-43b4-b2c4-cadcbbb4319e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:13:49.694951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efb6ee-7c89-43b4-b2c4-cadcbbb4319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:13:49.714259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-62efb6ee-7c89-43b4-b2c4-cadcbbb4319e None None] MFA Rules not processed for user `0b4ee04a6c6d42fd9bc97d5e356d4a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:13:49.715486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-62efb6ee-7c89-43b4-b2c4-cadcbbb4319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:13:49.863883 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1147/2318] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:13:59.783690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=25 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:01.152689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:01.162251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f5a4f-3b1a-4629-aea2-a27b7f4f1eae service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:01.166304 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13cf0a-3b2f-46aa-aad2-8840333ca42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:01.167095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13cf0a-3b2f-46aa-aad2-8840333ca42e service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:01.167476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13cf0a-3b2f-46aa-aad2-8840333ca42e service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:01.167850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13cf0a-3b2f-46aa-aad2-8840333ca42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:01.169699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8e13cf0a-3b2f-46aa-aad2-8840333ca42e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:01.266501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13cf0a-3b2f-46aa-aad2-8840333ca42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:01.268603 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13cf0a-3b2f-46aa-aad2-8840333ca42e service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:01.280458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1172/2319] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:14:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:14:02.629676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efb6ee-7c89-43b4-b2c4-cadcbbb4319e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:02.705338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efb6ee-7c89-43b4-b2c4-cadcbbb4319e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:02.711131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:02.712085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:02.713193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:02.713363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] PATH_INFO: `/v3/users/a00998ec0bb54534a8751b1efd3025a8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:02.714553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00998ec0bb54534a8751b1efd3025a8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:02.716679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:02.903293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00998ec0bb54534a8751b1efd3025a8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:02.911227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00998ec0bb54534a8751b1efd3025a8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:02.923096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00998ec0bb54534a8751b1efd3025a8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:03.010128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00998ec0bb54534a8751b1efd3025a8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:03.010829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00998ec0bb54534a8751b1efd3025a8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:03.017383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1148/2320] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:14:02 2022] DELETE /identity/v3/users/a00998ec0bb54534a8751b1efd3025a8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:14:03.022212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ef1e-87cb-4c78-9f06-024c3cb73bce None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:03.022694 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ef1e-87cb-4c78-9f06-024c3cb73bce None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:03.022921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ef1e-87cb-4c78-9f06-024c3cb73bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:03.042323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cfa9ef1e-87cb-4c78-9f06-024c3cb73bce None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:14:03.043609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cfa9ef1e-87cb-4c78-9f06-024c3cb73bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:03.105905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1173/2321] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:14:03.116500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:03.117963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:03.184068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed9a7-106b-400b-b47a-e528809dd58c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:03.187851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dc4d7-bdf5-4a28-a3d7-b7c99d4a53c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:03.188568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc4d7-bdf5-4a28-a3d7-b7c99d4a53c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:03.188882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc4d7-bdf5-4a28-a3d7-b7c99d4a53c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:03.189156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc4d7-bdf5-4a28-a3d7-b7c99d4a53c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:03.199118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dc4d7-bdf5-4a28-a3d7-b7c99d4a53c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:03.200602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dc4d7-bdf5-4a28-a3d7-b7c99d4a53c4 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:03.211148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1149/2322] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:14:03.596002 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ef1e-87cb-4c78-9f06-024c3cb73bce None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:03.601148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cfa9ef1e-87cb-4c78-9f06-024c3cb73bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:03.614294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ef1e-87cb-4c78-9f06-024c3cb73bce None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:03.619086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:03.619734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:03.620019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:03.620352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] PATH_INFO: `/v3/projects/7dc49614c62441aba065fe6b5853eda3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:03.621559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc49614c62441aba065fe6b5853eda3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:03.623562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:03.740343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc49614c62441aba065fe6b5853eda3', 'request_id': 'req-6198a52d-033a-4b41-9cc3-e8e2c118cc43'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:03.752291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc49614c62441aba065fe6b5853eda3', 'request_id': 'req-6198a52d-033a-4b41-9cc3-e8e2c118cc43'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:03.761526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc49614c62441aba065fe6b5853eda3', 'request_id': 'req-6198a52d-033a-4b41-9cc3-e8e2c118cc43'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:03.821812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] The token cache is being invalidate because project 7dc49614c62441aba065fe6b5853eda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:14:03.822252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:03.823111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6198a52d-033a-4b41-9cc3-e8e2c118cc43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:14:03.828253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1174/2323] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:14:03 2022] DELETE /identity/v3/projects/7dc49614c62441aba065fe6b5853eda3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:14:03.830763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801c256-a5a2-4cc3-80a7-3d174fd11e6a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:03.831703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801c256-a5a2-4cc3-80a7-3d174fd11e6a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:03.831981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801c256-a5a2-4cc3-80a7-3d174fd11e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:03.854674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c801c256-a5a2-4cc3-80a7-3d174fd11e6a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:14:03.857728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c801c256-a5a2-4cc3-80a7-3d174fd11e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:03.874169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:03.929398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1150/2324] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:14:03.931277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc237e-7a4a-48b6-8e91-10ac28bd88ea None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:03.931865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc237e-7a4a-48b6-8e91-10ac28bd88ea None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:03.932300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc237e-7a4a-48b6-8e91-10ac28bd88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:03.954956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-13bc237e-7a4a-48b6-8e91-10ac28bd88ea None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:14:03.956241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-13bc237e-7a4a-48b6-8e91-10ac28bd88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:03.966703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1175/2325] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:14:03.969411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801c256-a5a2-4cc3-80a7-3d174fd11e6a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:03.979795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801c256-a5a2-4cc3-80a7-3d174fd11e6a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:03.985537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:03.989798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:03.989798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:03.989798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:03.989798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:14:03.989798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:03.989798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:04.002343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1151/2326] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:14:04.007011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc237e-7a4a-48b6-8e91-10ac28bd88ea None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:04.016715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc237e-7a4a-48b6-8e91-10ac28bd88ea None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:04.022828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccd529-124c-4180-a599-e058dd0c8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:04.023583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd529-124c-4180-a599-e058dd0c8958 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:04.023873 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd529-124c-4180-a599-e058dd0c8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:04.024211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd529-124c-4180-a599-e058dd0c8958 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:04.024960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccd529-124c-4180-a599-e058dd0c8958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:04.027084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccd529-124c-4180-a599-e058dd0c8958 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:04.038624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:04.215713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1176/2327] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:14:04 2022] POST /identity/v3/projects => generated 365 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:14:04.221465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:04.232942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be12e33-804f-4627-8830-2d35c953aaae admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:04.294803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a929c-185f-4db9-ae1f-be9cbbd54f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:04.295413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a929c-185f-4db9-ae1f-be9cbbd54f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:04.295747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a929c-185f-4db9-ae1f-be9cbbd54f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:04.296023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a929c-185f-4db9-ae1f-be9cbbd54f62 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:04.296695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a929c-185f-4db9-ae1f-be9cbbd54f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:04.298584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a929c-185f-4db9-ae1f-be9cbbd54f62 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:04.396770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1152/2328] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:14:04 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:14:04.400882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccd529-124c-4180-a599-e058dd0c8958 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:04.412234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccd529-124c-4180-a599-e058dd0c8958 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:04.417620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad5e1d-e040-45bb-aa8a-896722c1778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:04.420158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5e1d-e040-45bb-aa8a-896722c1778b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:04.420158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5e1d-e040-45bb-aa8a-896722c1778b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:04.420158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5e1d-e040-45bb-aa8a-896722c1778b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:04.420158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad5e1d-e040-45bb-aa8a-896722c1778b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:04.421413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad5e1d-e040-45bb-aa8a-896722c1778b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:04.432544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1177/2329] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:14:04.436659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a929c-185f-4db9-ae1f-be9cbbd54f62 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:04.447747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a929c-185f-4db9-ae1f-be9cbbd54f62 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:04.452594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9238307-897f-40b2-8e3e-aaee99b84070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:04.453202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238307-897f-40b2-8e3e-aaee99b84070 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:04.453484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238307-897f-40b2-8e3e-aaee99b84070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:04.453760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238307-897f-40b2-8e3e-aaee99b84070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:04.454455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9238307-897f-40b2-8e3e-aaee99b84070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:04.456076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9238307-897f-40b2-8e3e-aaee99b84070 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:04.471264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1153/2330] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:14:04.484211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad5e1d-e040-45bb-aa8a-896722c1778b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:04.496039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad5e1d-e040-45bb-aa8a-896722c1778b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:04.500921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:04.501799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:04.502113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:04.502392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] PATH_INFO: `/v3/projects/a1e1cd72bc58473cad31e4887602deed/users/0f0dfeed6d624a4a843c4dbb6fc38f49/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:04.524271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1cd72bc58473cad31e4887602deed, user_id=0f0dfeed6d624a4a843c4dbb6fc38f49, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:04.532459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:04.594422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1178/2331] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:14:04 2022] PUT /identity/v3/projects/a1e1cd72bc58473cad31e4887602deed/users/0f0dfeed6d624a4a843c4dbb6fc38f49/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:14:04.607101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf034-d560-4695-871d-02d79a0184e8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:04.607458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf034-d560-4695-871d-02d79a0184e8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:04.607864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf034-d560-4695-871d-02d79a0184e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:04.646683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-88fcf034-d560-4695-871d-02d79a0184e8 None None] MFA Rules not processed for user `0f0dfeed6d624a4a843c4dbb6fc38f49`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:14:04.648027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-88fcf034-d560-4695-871d-02d79a0184e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:04.721382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1154/2332] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:14:04.733803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:04.735458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:04.803306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53671cc-69ba-4f2f-82e7-3365a4d12049 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:04.807043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:04.807687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:04.808029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:04.808306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:04.818945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:04.820457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:04.830151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1179/2333] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:14:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:14:11.173928 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e5306-5c1b-46d7-b37a-861c7c365144 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:11.174492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e5306-5c1b-46d7-b37a-861c7c365144 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:11.174592 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e5306-5c1b-46d7-b37a-861c7c365144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:11.194697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e68e5306-5c1b-46d7-b37a-861c7c365144 None None] MFA Rules not processed for user `338bde3096e44d81b2157690c75bfa05`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:14:11.195889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e68e5306-5c1b-46d7-b37a-861c7c365144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:11.208448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:11.257454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1155/2334] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:14:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:14:14.825596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:21.622628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=17 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:32.161373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:32.162829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:32.223948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef4e2-ce9e-43dc-8e18-eb740190e42a service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:32.227691 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:32.228324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:32.228645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:32.228923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:32.230940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:32.308451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:32.310132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:32.322607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1180/2335] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:14:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:14:33.566952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e5306-5c1b-46d7-b37a-861c7c365144 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:33.577029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e5306-5c1b-46d7-b37a-861c7c365144 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:33.580654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:33.581258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:33.581540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:33.581817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:33.583535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:33.597239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:33.598661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:33.610208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1156/2336] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:14:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:14:42.316957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=54 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:43.604733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:45.925400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:45.935874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77418f-b35f-481f-bdc1-569910c169cc service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:45.939465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:45.940065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:45.940344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:45.940646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:45.942355 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:46.005112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:46.006541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:46.016066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1181/2337] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:14:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:14:51.154955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:51.164180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa6c08-43d5-4d15-976a-73a1c4713210 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:51.167784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:51.170639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:51.170639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:51.170639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:51.170937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:51.229548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:51.231245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:51.240196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1157/2338] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:14:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:14:51.512303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:14:51.520985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e90c3-3501-40e9-a9d5-b30f964dddaf service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:14:51.524543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffa530-b85a-45a6-98e9-833f7cedafe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:14:51.525133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffa530-b85a-45a6-98e9-833f7cedafe8 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:14:51.525415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffa530-b85a-45a6-98e9-833f7cedafe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:14:51.525687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffa530-b85a-45a6-98e9-833f7cedafe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:14:51.527390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-adffa530-b85a-45a6-98e9-833f7cedafe8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:14:51.588230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffa530-b85a-45a6-98e9-833f7cedafe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:14:51.589719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffa530-b85a-45a6-98e9-833f7cedafe8 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:14:51.598813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1182/2339] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:14:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:15:01.236016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=28 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:01.594738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=56 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:37.665167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:15:37.675800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920dd4f-1919-4a63-9246-57adff1d4bee service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:15:37.679687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:15:37.680304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:15:37.680644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:15:37.680925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:15:37.682701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:37.693163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:15:37.694684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:15:37.703030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1158/2340] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:15:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:15:41.515806 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764faf6-b0e0-4826-84e9-68f35cae08ed None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:15:41.516344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764faf6-b0e0-4826-84e9-68f35cae08ed None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:15:41.516344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764faf6-b0e0-4826-84e9-68f35cae08ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:15:41.535796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b764faf6-b0e0-4826-84e9-68f35cae08ed None None] MFA Rules not processed for user `fb7200a9769b46b3a79c9fe6287a1724`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:15:41.537046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b764faf6-b0e0-4826-84e9-68f35cae08ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:41.543968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1183/2341] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:15:41.855071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:15:41.864944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e350-d539-443d-858a-a6766fe91a6d service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:15:41.868594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:15:41.869268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:15:41.869621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:15:41.869967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:15:41.871794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:41.882692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:15:41.884109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:15:41.892934 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1159/2342] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:15:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:15:42.361978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764faf6-b0e0-4826-84e9-68f35cae08ed None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:15:42.363370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b764faf6-b0e0-4826-84e9-68f35cae08ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:42.446405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764faf6-b0e0-4826-84e9-68f35cae08ed None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:15:42.453494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:15:42.453494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:15:42.453494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:15:42.453494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:15:42.455128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:42.467638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:15:42.469607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:15:42.479487 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1184/2343] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:15:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:15:47.008814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:15:47.010238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:47.041704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13974fed-e8ea-49e2-9641-8bbd451343d3 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:15:47.048890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:15:47.049510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:15:47.049794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:15:47.050073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:15:47.052144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:47.065094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:15:47.066846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:15:47.082308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1160/2344] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:15:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:15:52.475309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=35 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:54.025191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:15:54.029072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:54.041444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197c5da-4810-4542-9a92-5a16f3b88cec service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:15:54.046994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:15:54.047584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:15:54.047862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:15:54.048133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:15:54.049945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:15:54.062210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:15:54.063767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:15:54.074206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1185/2345] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:15:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:15:57.076836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=18 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:04.069837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:26.658506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:16:26.659906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:16:26.723579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea19e7-9d07-4e66-ad9e-802ad5589cb1 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:16:26.727112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:16:26.727712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:16:26.727990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:16:26.728259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:16:26.730010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:16:26.805610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:16:26.807036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:16:26.816190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1161/2346] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:16:36.811814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=56 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:47.685661 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:16:47.727985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159f61-0c86-48c1-85ea-b02c40e9e009 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:16:47.734045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:16:47.734687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:16:47.734964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:16:47.735235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:16:47.737668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:16:47.799362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:16:47.800999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:16:47.810231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1186/2347] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:16:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:16:51.886035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:16:51.899707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30f947-8291-40c7-a25f-89b72c38995d service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:16:51.905128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:16:51.905747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:16:51.906026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:16:51.906295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:16:51.908167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:16:51.918571 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:16:51.920138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:16:51.932851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1162/2348] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:16:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:16:57.805818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=42 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:01.925060 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:26.499291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:17:26.510665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953eaf-5b13-43de-a928-a74c5d6e2e88 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:17:26.516070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:17:26.516715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:17:26.517007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:17:26.517291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:17:26.519032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:17:26.577995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:17:26.580167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:17:26.588947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1187/2349] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:17:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:17:36.585662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=28 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:43.850875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:18:43.852373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:18:43.888392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a041421-e4a0-4565-b954-6230fa1c3cae service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:18:43.893992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:18:43.894724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:18:43.895002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:18:43.895269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:18:43.897042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:18:43.908421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:18:43.910623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:18:43.920354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1163/2350] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:18:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:18:53.916236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=15 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:32.280130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:19:32.298688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ed01-d670-4c3c-8c88-4969e4917ca4 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:19:32.302295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a626fc-15f8-465f-9d5b-9fe7f46b52f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:19:32.302886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a626fc-15f8-465f-9d5b-9fe7f46b52f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:19:32.303166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a626fc-15f8-465f-9d5b-9fe7f46b52f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:19:32.303434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a626fc-15f8-465f-9d5b-9fe7f46b52f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:19:32.321044 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a626fc-15f8-465f-9d5b-9fe7f46b52f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:19:32.322486 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a626fc-15f8-465f-9d5b-9fe7f46b52f6 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:19:32.343644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1188/2351] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:19:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:19:39.279720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:19:39.291561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abe6e-6088-4bae-b6c1-8ffa235eb271 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:19:39.295673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e179da7-7606-44b0-9e8c-7f7af29e82ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:19:39.296285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e179da7-7606-44b0-9e8c-7f7af29e82ef service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:19:39.296595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e179da7-7606-44b0-9e8c-7f7af29e82ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:19:39.296874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e179da7-7606-44b0-9e8c-7f7af29e82ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:19:39.306728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e179da7-7606-44b0-9e8c-7f7af29e82ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:19:39.308170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e179da7-7606-44b0-9e8c-7f7af29e82ef service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:19:39.317527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1164/2352] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:19:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:19:39.364032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a626fc-15f8-465f-9d5b-9fe7f46b52f6 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:19:39.374631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a626fc-15f8-465f-9d5b-9fe7f46b52f6 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:19:39.379221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55cb73-51d1-4744-b250-470df7cdf8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:19:39.380285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cb73-51d1-4744-b250-470df7cdf8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:19:39.380285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cb73-51d1-4744-b250-470df7cdf8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:19:39.380606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cb73-51d1-4744-b250-470df7cdf8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:19:39.391029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55cb73-51d1-4744-b250-470df7cdf8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:19:39.393203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55cb73-51d1-4744-b250-470df7cdf8d3 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:19:39.404364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1189/2353] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:19:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:19:49.313166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:49.399244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=23 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:39.768792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e179da7-7606-44b0-9e8c-7f7af29e82ef service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:20:39.781158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e179da7-7606-44b0-9e8c-7f7af29e82ef service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:20:39.787575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e2fb-08d5-44c8-a933-9b5b0bdb69c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:20:39.788176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e2fb-08d5-44c8-a933-9b5b0bdb69c2 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:20:39.788460 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e2fb-08d5-44c8-a933-9b5b0bdb69c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:20:39.788780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e2fb-08d5-44c8-a933-9b5b0bdb69c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:20:39.796975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e2fb-08d5-44c8-a933-9b5b0bdb69c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:20:39.798569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e2fb-08d5-44c8-a933-9b5b0bdb69c2 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:20:39.825463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1165/2354] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:20:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:20:49.822756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=13 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:50.498499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55cb73-51d1-4744-b250-470df7cdf8d3 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:20:50.508645 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55cb73-51d1-4744-b250-470df7cdf8d3 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:20:50.512314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d6a73-de7c-4447-ae03-2aa14a2c4585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:20:50.512970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d6a73-de7c-4447-ae03-2aa14a2c4585 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:20:50.513254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d6a73-de7c-4447-ae03-2aa14a2c4585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:20:50.513532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d6a73-de7c-4447-ae03-2aa14a2c4585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:20:50.520758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d6a73-de7c-4447-ae03-2aa14a2c4585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:20:50.523783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d6a73-de7c-4447-ae03-2aa14a2c4585 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:20:50.530182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1190/2355] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:20:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:21:00.526641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:39.773248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e2fb-08d5-44c8-a933-9b5b0bdb69c2 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:21:39.782269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e2fb-08d5-44c8-a933-9b5b0bdb69c2 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:21:39.785868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168956b7-17e9-4e04-814b-628aa4c4b6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:21:39.787071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168956b7-17e9-4e04-814b-628aa4c4b6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:21:39.787361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168956b7-17e9-4e04-814b-628aa4c4b6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:21:39.787662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168956b7-17e9-4e04-814b-628aa4c4b6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:21:39.796218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168956b7-17e9-4e04-814b-628aa4c4b6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:21:39.797660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168956b7-17e9-4e04-814b-628aa4c4b6f2 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:21:39.825503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1166/2356] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:21:39.907602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d6a73-de7c-4447-ae03-2aa14a2c4585 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:21:39.917349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d6a73-de7c-4447-ae03-2aa14a2c4585 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:21:39.920914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c6bf6-61ce-4d1c-9222-ed3e371bce30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:21:39.921505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6bf6-61ce-4d1c-9222-ed3e371bce30 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:21:39.921789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6bf6-61ce-4d1c-9222-ed3e371bce30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:21:39.922062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6bf6-61ce-4d1c-9222-ed3e371bce30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:21:39.931392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c6bf6-61ce-4d1c-9222-ed3e371bce30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:21:39.932856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c6bf6-61ce-4d1c-9222-ed3e371bce30 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:21:39.959639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1191/2357] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:21:40.003274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168956b7-17e9-4e04-814b-628aa4c4b6f2 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:21:40.011727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168956b7-17e9-4e04-814b-628aa4c4b6f2 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:21:40.015397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3bde-a33d-401a-a1d0-ebdc18964345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:21:40.015993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3bde-a33d-401a-a1d0-ebdc18964345 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:21:40.016271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3bde-a33d-401a-a1d0-ebdc18964345 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:21:40.016598 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3bde-a33d-401a-a1d0-ebdc18964345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:21:40.025324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a3bde-a33d-401a-a1d0-ebdc18964345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:21:40.026726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a3bde-a33d-401a-a1d0-ebdc18964345 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:21:40.054031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1167/2358] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:21:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:21:49.956845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=13 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:50.051177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=26 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:06.463536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c6bf6-61ce-4d1c-9222-ed3e371bce30 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:23:06.478360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c6bf6-61ce-4d1c-9222-ed3e371bce30 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:23:06.484473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5f60d-ea37-445d-9d38-c1311d0c2e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:23:06.485308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5f60d-ea37-445d-9d38-c1311d0c2e47 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:23:06.485598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5f60d-ea37-445d-9d38-c1311d0c2e47 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:23:06.485934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5f60d-ea37-445d-9d38-c1311d0c2e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:23:06.489209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3bde-a33d-401a-a1d0-ebdc18964345 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:23:06.495286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5f60d-ea37-445d-9d38-c1311d0c2e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:23:06.496905 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5f60d-ea37-445d-9d38-c1311d0c2e47 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:23:06.498156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3bde-a33d-401a-a1d0-ebdc18964345 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:23:06.501844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e817-7417-4190-ad74-4340363d57bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:23:06.502467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e817-7417-4190-ad74-4340363d57bf service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:23:06.502739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e817-7417-4190-ad74-4340363d57bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:23:06.503006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e817-7417-4190-ad74-4340363d57bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:23:06.511630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913e817-7417-4190-ad74-4340363d57bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:23:06.513299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913e817-7417-4190-ad74-4340363d57bf service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:23:06.524316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1192/2359] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:23:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:23:06.542498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1168/2360] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:23:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:23:06.670967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5f60d-ea37-445d-9d38-c1311d0c2e47 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:23:06.685582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5f60d-ea37-445d-9d38-c1311d0c2e47 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:23:06.689476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580b5c7-8136-43ac-a980-16752e0bccc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:23:06.690084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580b5c7-8136-43ac-a980-16752e0bccc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:23:06.690368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580b5c7-8136-43ac-a980-16752e0bccc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:23:06.690663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580b5c7-8136-43ac-a980-16752e0bccc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:23:06.700317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e817-7417-4190-ad74-4340363d57bf service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:23:06.700879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580b5c7-8136-43ac-a980-16752e0bccc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:23:06.702519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580b5c7-8136-43ac-a980-16752e0bccc3 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:23:06.712775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e817-7417-4190-ad74-4340363d57bf service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:23:06.718652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca4ec2-25f8-4a1d-908d-bed5c0c1baf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:23:06.719363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4ec2-25f8-4a1d-908d-bed5c0c1baf1 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:23:06.719730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4ec2-25f8-4a1d-908d-bed5c0c1baf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:23:06.720069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4ec2-25f8-4a1d-908d-bed5c0c1baf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:23:06.728415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca4ec2-25f8-4a1d-908d-bed5c0c1baf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:23:06.730069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca4ec2-25f8-4a1d-908d-bed5c0c1baf1 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:23:06.730459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1193/2361] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:23:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:23:06.740398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1169/2362] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:23:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:23:16.727720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=26 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:16.735282 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=19 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:49.846166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580b5c7-8136-43ac-a980-16752e0bccc3 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:23:49.846166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580b5c7-8136-43ac-a980-16752e0bccc3 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:23:49.846166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d25d3-877a-4f44-9a6b-ab085c78c07e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:23:49.846166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d25d3-877a-4f44-9a6b-ab085c78c07e service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:23:49.846952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d25d3-877a-4f44-9a6b-ab085c78c07e service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:23:49.846952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d25d3-877a-4f44-9a6b-ab085c78c07e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:23:49.846952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d25d3-877a-4f44-9a6b-ab085c78c07e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:23:49.846952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d25d3-877a-4f44-9a6b-ab085c78c07e service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:23:49.849272 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1194/2363] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:23:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:23:59.844919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:25:06.768426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca4ec2-25f8-4a1d-908d-bed5c0c1baf1 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:25:06.823444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca4ec2-25f8-4a1d-908d-bed5c0c1baf1 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:25:06.827006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:25:06.827603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:25:06.827878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:25:06.828147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:25:06.830007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:25:06.911305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:25:06.912863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:25:06.931133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1170/2364] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:25:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:25:07.012781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d25d3-877a-4f44-9a6b-ab085c78c07e service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:25:07.021789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d25d3-877a-4f44-9a6b-ab085c78c07e service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:25:07.025947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:25:07.026528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:25:07.026803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:25:07.027075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:25:07.029028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:25:07.111100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:25:07.112578 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:25:07.123703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1195/2365] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:25:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:25:07.169533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:25:07.176130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3ef0-64f6-41ee-a28a-180a29112a21 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:25:07.180071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:25:07.180708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:25:07.180993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:25:07.181270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:25:07.183098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:25:07.197237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:25:07.198786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:25:07.211030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1171/2366] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:25:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:25:17.118954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=39 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:25:17.204960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=67 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:25:40.724451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:25:40.726089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:25:40.737065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad96d1-2fda-4140-b88b-ac3098711f97 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:25:40.740982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:25:40.741616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:25:40.742113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:25:40.742461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:25:40.744393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:25:40.815566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:25:40.817041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:25:40.826681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1196/2367] 10.222.0.75 () {60 vars in 1396 bytes} [Mon Sep 19 15:25:40 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:25:50.822502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=33 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:25:57.536213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:25:57.539037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:25:57.609478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5cfff-89f8-43be-b639-2807d265e4aa service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:25:57.615342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:25:57.616220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:25:57.616579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:25:57.616951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:25:57.619830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:25:57.632746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:25:57.634345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:25:57.644870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1172/2368] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:25:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:26:07.641037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=31 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:07.411074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:27:07.412684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:27:07.474703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b51b15-d48e-449a-a4a2-51ae29e3461e service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:27:07.478425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:27:07.479043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:27:07.479325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:27:07.479600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:27:07.481462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:27:07.567364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:27:07.568842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:27:07.578748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1197/2369] 10.222.0.75 () {60 vars in 1396 bytes} [Mon Sep 19 15:27:07 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:27:17.574484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=61 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:41.008101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:27:41.009822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:27:41.069467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613c00-d1e6-4e7c-a612-ab6f3cd43a75 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:27:41.075596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:27:41.076245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:27:41.076586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:27:41.076897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:27:41.078903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:27:41.152274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:27:41.153900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:27:41.163111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1173/2370] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:27:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:27:41.507140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:27:41.519753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434984d-5689-44b5-957c-a512942d82c8 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:27:41.525723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:27:41.526320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:27:41.526596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:27:41.526866 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:27:41.528721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:27:41.541255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:27:41.543903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:27:41.553098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1198/2371] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:27:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:27:51.158730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=49 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:51.548777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:28:55.801601 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:28:55.803185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:28:55.893876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3ced-de6e-4531-b2fd-1e3bd6703fcb service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:28:55.899064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:28:55.901445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:28:55.901445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:28:55.901445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:28:55.902034 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:28:55.914175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:28:55.915736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:28:55.925878 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1174/2372] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:28:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:29:05.921745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=41 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:07.739824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:07.739824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:07.758191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062cace-f8b7-432a-a318-c7ab5ab0d594 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:07.763872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:07.775430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:07.775430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:07.775430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:07.775430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:07.846158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:07.847767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:07.857213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1199/2373] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:08.024126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:08.038642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8c53b-af65-45a3-a82e-2f7c6eee8ac6 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:08.045093 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:08.048008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:08.048008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:08.048008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:08.048397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:08.122075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:08.124184 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:08.133372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1175/2374] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:08.226407 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:08.237692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61911136-d291-4f8c-9cf6-c69c7e618d55 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:08.243932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:08.244582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:08.244865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:08.245140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:08.247030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:08.321998 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:08.323576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:08.333676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1200/2375] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:18.129123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=33 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:18.329196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=66 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:41.238838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:41.240553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:41.332818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:41.365521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5958b-e390-4e26-a5fc-ede159fee67d service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:41.372519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870e629-b081-4153-9af1-8f41a5571886 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:41.377016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:41.378330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:41.378651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:41.378927 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] PATH_INFO: `/v3/users/0f0dfeed6d624a4a843c4dbb6fc38f49` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:41.380064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f0dfeed6d624a4a843c4dbb6fc38f49)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:41.382129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:41.387501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efee885-9aaa-4a78-bd35-5c8e2481d2b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:41.388533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee885-9aaa-4a78-bd35-5c8e2481d2b8 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:41.388832 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee885-9aaa-4a78-bd35-5c8e2481d2b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:41.389664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee885-9aaa-4a78-bd35-5c8e2481d2b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:41.392850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2efee885-9aaa-4a78-bd35-5c8e2481d2b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:41.477415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efee885-9aaa-4a78-bd35-5c8e2481d2b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:41.481499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efee885-9aaa-4a78-bd35-5c8e2481d2b8 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:41.491793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1201/2376] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:41.587488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f0dfeed6d624a4a843c4dbb6fc38f49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:41.595246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f0dfeed6d624a4a843c4dbb6fc38f49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:41.608909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f0dfeed6d624a4a843c4dbb6fc38f49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:41.699839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f0dfeed6d624a4a843c4dbb6fc38f49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:41.700516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f0dfeed6d624a4a843c4dbb6fc38f49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:41.708463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1176/2377] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:29:41 2022] DELETE /identity/v3/users/0f0dfeed6d624a4a843c4dbb6fc38f49 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:29:41.712999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284225-7dc8-4947-a4a5-02397acad62d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:41.713370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284225-7dc8-4947-a4a5-02397acad62d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:41.713576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284225-7dc8-4947-a4a5-02397acad62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:41.746878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fd284225-7dc8-4947-a4a5-02397acad62d None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:29:41.748703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fd284225-7dc8-4947-a4a5-02397acad62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:41.836130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1202/2378] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:29:41.843675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:41.845170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:41.916435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:41.946224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e63f-1f3c-46e5-96e8-4d762c07d8f9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:41.954259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd723cd-56b3-4b2c-b61f-ace12cbe809b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:41.954884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd723cd-56b3-4b2c-b61f-ace12cbe809b service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:41.955163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd723cd-56b3-4b2c-b61f-ace12cbe809b service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:41.955435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd723cd-56b3-4b2c-b61f-ace12cbe809b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:41.968852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd723cd-56b3-4b2c-b61f-ace12cbe809b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:41.974169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd723cd-56b3-4b2c-b61f-ace12cbe809b service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:41.983444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1177/2379] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:42.514285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd284225-7dc8-4947-a4a5-02397acad62d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:42.514285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fd284225-7dc8-4947-a4a5-02397acad62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:42.525848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd284225-7dc8-4947-a4a5-02397acad62d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:42.530655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:42.531290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:42.531726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:42.532161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] PATH_INFO: `/v3/projects/a1e1cd72bc58473cad31e4887602deed` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:42.536358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e1cd72bc58473cad31e4887602deed)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:42.536358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:42.668156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e1cd72bc58473cad31e4887602deed', 'request_id': 'req-e39de45f-8265-4613-8461-536f6729ae01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:42.674814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e1cd72bc58473cad31e4887602deed', 'request_id': 'req-e39de45f-8265-4613-8461-536f6729ae01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:42.678110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:42.683276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e1cd72bc58473cad31e4887602deed', 'request_id': 'req-e39de45f-8265-4613-8461-536f6729ae01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:42.780636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] The token cache is being invalidate because project a1e1cd72bc58473cad31e4887602deed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:29:42.781007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:42.783099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e39de45f-8265-4613-8461-536f6729ae01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:29:42.785564 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1203/2380] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:29:42 2022] DELETE /identity/v3/projects/a1e1cd72bc58473cad31e4887602deed => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:29:42.792211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d2fa-fdda-4c3e-83dc-7d9498a9c12e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:42.792732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d2fa-fdda-4c3e-83dc-7d9498a9c12e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:42.792833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d2fa-fdda-4c3e-83dc-7d9498a9c12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:42.856278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1c76d2fa-fdda-4c3e-83dc-7d9498a9c12e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:29:42.857546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1c76d2fa-fdda-4c3e-83dc-7d9498a9c12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:42.935620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1178/2381] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:29:42.943636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df20f-aa1c-4d9c-b953-5ac641d422b0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:42.944001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df20f-aa1c-4d9c-b953-5ac641d422b0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:42.944201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df20f-aa1c-4d9c-b953-5ac641d422b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:42.968939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-eb3df20f-aa1c-4d9c-b953-5ac641d422b0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:29:42.969625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-eb3df20f-aa1c-4d9c-b953-5ac641d422b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:42.978994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1204/2382] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:29:42.983325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76d2fa-fdda-4c3e-83dc-7d9498a9c12e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:42.995304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76d2fa-fdda-4c3e-83dc-7d9498a9c12e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:43.000178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:43.000827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.001237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.001517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.002165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:29:43.002470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:43.005110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:43.024443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1179/2383] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:29:43.025541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3df20f-aa1c-4d9c-b953-5ac641d422b0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:43.035923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3df20f-aa1c-4d9c-b953-5ac641d422b0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:43.040619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402532b0-f752-4f13-aad3-6f0d7704f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:43.041789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402532b0-f752-4f13-aad3-6f0d7704f77d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.041789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402532b0-f752-4f13-aad3-6f0d7704f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.041789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402532b0-f752-4f13-aad3-6f0d7704f77d admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.042391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402532b0-f752-4f13-aad3-6f0d7704f77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:43.044333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402532b0-f752-4f13-aad3-6f0d7704f77d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:43.153498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1205/2384] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:29:43 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:29:43.155355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:43.166594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef925c-f833-4d9a-bad6-3f056b7290a2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:43.228809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e0bff-fdab-4e8d-af80-bfebc7668667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:43.229620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0bff-fdab-4e8d-af80-bfebc7668667 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.229915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0bff-fdab-4e8d-af80-bfebc7668667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.230195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0bff-fdab-4e8d-af80-bfebc7668667 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.230816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e0bff-fdab-4e8d-af80-bfebc7668667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:43.232789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e0bff-fdab-4e8d-af80-bfebc7668667 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:43.326047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1180/2385] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:29:43 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:29:43.329229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402532b0-f752-4f13-aad3-6f0d7704f77d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:43.345703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402532b0-f752-4f13-aad3-6f0d7704f77d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:43.350154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2cb0-e6cf-4fcc-8bc8-20ba2f74039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:43.350846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2cb0-e6cf-4fcc-8bc8-20ba2f74039b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.351318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2cb0-e6cf-4fcc-8bc8-20ba2f74039b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.351589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2cb0-e6cf-4fcc-8bc8-20ba2f74039b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.352444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2cb0-e6cf-4fcc-8bc8-20ba2f74039b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:43.354773 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2cb0-e6cf-4fcc-8bc8-20ba2f74039b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:43.365879 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1206/2386] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:29:43.370232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e0bff-fdab-4e8d-af80-bfebc7668667 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:43.383018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e0bff-fdab-4e8d-af80-bfebc7668667 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:43.388299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c46a0-7e41-4ba5-915c-30a3221e1aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:43.388955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c46a0-7e41-4ba5-915c-30a3221e1aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.389238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c46a0-7e41-4ba5-915c-30a3221e1aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.389523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c46a0-7e41-4ba5-915c-30a3221e1aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.390191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c46a0-7e41-4ba5-915c-30a3221e1aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:43.391924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c46a0-7e41-4ba5-915c-30a3221e1aa7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:43.410275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1181/2387] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:29:43.410464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2cb0-e6cf-4fcc-8bc8-20ba2f74039b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:43.420716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2cb0-e6cf-4fcc-8bc8-20ba2f74039b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:43.427433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:43.428102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.428704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.429100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] PATH_INFO: `/v3/projects/68b3f55c8c5d4b62bfcd11677216a12f/users/0ba6fac98ba44c04ac5b06ae52b35975/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.445842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b3f55c8c5d4b62bfcd11677216a12f, user_id=0ba6fac98ba44c04ac5b06ae52b35975, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:43.448528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:43.525276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1207/2388] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:29:43 2022] PUT /identity/v3/projects/68b3f55c8c5d4b62bfcd11677216a12f/users/0ba6fac98ba44c04ac5b06ae52b35975/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:29:43.536212 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733f80-9d18-4297-b390-0b93cf806fc6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.536540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733f80-9d18-4297-b390-0b93cf806fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.536832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733f80-9d18-4297-b390-0b93cf806fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.567036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4f733f80-9d18-4297-b390-0b93cf806fc6 None None] MFA Rules not processed for user `0ba6fac98ba44c04ac5b06ae52b35975`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:29:43.569352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4f733f80-9d18-4297-b390-0b93cf806fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:43.584206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:43.647128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1182/2389] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:29:43.660757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:43.662365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:43.681996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce8e80-7aee-46cf-a3a8-b72dd1664733 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.682289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce8e80-7aee-46cf-a3a8-b72dd1664733 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.684849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce8e80-7aee-46cf-a3a8-b72dd1664733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.732204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-90ce8e80-7aee-46cf-a3a8-b72dd1664733 None None] MFA Rules not processed for user `c0121ba668034aac98863a2caf80320e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:29:43.734040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-90ce8e80-7aee-46cf-a3a8-b72dd1664733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:43.792648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca980c6-ddbf-44dd-a219-f006bee19e78 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:43.798402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:43.798402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:43.798402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:43.798794 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:43.806829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1183/2390] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:29:43.809448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:43.810970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:43.831045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1208/2391] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:45.100549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce8e80-7aee-46cf-a3a8-b72dd1664733 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:45.102249 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-90ce8e80-7aee-46cf-a3a8-b72dd1664733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:45.169670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce8e80-7aee-46cf-a3a8-b72dd1664733 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:45.173491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7004f16-c5e6-486a-a903-b750476c3303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:45.174121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7004f16-c5e6-486a-a903-b750476c3303 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:45.174398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7004f16-c5e6-486a-a903-b750476c3303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:45.174674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7004f16-c5e6-486a-a903-b750476c3303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:45.177198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f7004f16-c5e6-486a-a903-b750476c3303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:45.196269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7004f16-c5e6-486a-a903-b750476c3303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:45.201096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7004f16-c5e6-486a-a903-b750476c3303 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:45.209096 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1184/2392] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:45.991390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:45.993259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:46.098801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af533d10-3bbe-4806-a578-3ea49e3171f4 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:46.106094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b336d2f-0fa3-4493-b5b4-45775661a1b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:46.106875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336d2f-0fa3-4493-b5b4-45775661a1b3 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:46.107252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336d2f-0fa3-4493-b5b4-45775661a1b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:46.107561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336d2f-0fa3-4493-b5b4-45775661a1b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:46.109446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0b336d2f-0fa3-4493-b5b4-45775661a1b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:46.126208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b336d2f-0fa3-4493-b5b4-45775661a1b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:46.128734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b336d2f-0fa3-4493-b5b4-45775661a1b3 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:46.158931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1209/2393] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:49.092030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd3610-5135-4610-a042-4ffb0ed806a3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:49.092459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd3610-5135-4610-a042-4ffb0ed806a3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:49.092639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd3610-5135-4610-a042-4ffb0ed806a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:49.121492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-88fd3610-5135-4610-a042-4ffb0ed806a3 None None] MFA Rules not processed for user `833edf46ef9b4d3982ce49abc74933a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:29:49.122625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-88fd3610-5135-4610-a042-4ffb0ed806a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:49.169716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:49.180711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1185/2394] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:29:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:29:49.292925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3e7e-9a47-4a72-bf83-c21923efd73d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:49.295784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3e7e-9a47-4a72-bf83-c21923efd73d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:49.295784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3e7e-9a47-4a72-bf83-c21923efd73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:49.302531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:49.323465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1a7a3e7e-9a47-4a72-bf83-c21923efd73d None None] MFA Rules not processed for user `808156c7457b4e8b9b6c5f305755b3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:29:49.325043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1a7a3e7e-9a47-4a72-bf83-c21923efd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:49.388633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1210/2395] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:29:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:29:49.876002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd3610-5135-4610-a042-4ffb0ed806a3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:49.885894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd3610-5135-4610-a042-4ffb0ed806a3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:49.889458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:49.890136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:49.890474 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:49.890810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:49.892605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:49.903048 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:49.904451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:49.913359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1186/2396] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:50.079458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a3e7e-9a47-4a72-bf83-c21923efd73d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:29:50.081389 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1a7a3e7e-9a47-4a72-bf83-c21923efd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:50.166782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a3e7e-9a47-4a72-bf83-c21923efd73d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:29:50.172167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:29:50.172975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:29:50.173327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:29:50.173676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:29:50.176880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:29:50.188989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:29:50.190592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:29:50.217699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1211/2397] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:29:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:29:59.909470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:00.197580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=58 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:01.989416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:30:02.005159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5bf9-5905-4e83-b093-37eb1e6e9cd8 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:30:02.010818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:30:02.011429 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:30:02.011708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:30:02.011983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:30:02.013733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:30:02.026760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:30:02.028338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:30:02.039056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1187/2398] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:30:07.465595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:30:07.475650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5ecc8-624f-45de-a10b-865faac7c0bd service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:30:07.479216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:30:07.479813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:30:07.480095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:30:07.480370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:30:07.482134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:30:07.496288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:30:07.497753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:30:07.508836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1212/2399] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:30:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:30:08.006589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:30:08.022412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9532-4b6f-480f-9a3c-5f0c2dcb016f service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:30:08.035726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:30:08.036672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:30:08.037120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:30:08.037547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:30:08.040689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:30:08.057730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:30:08.059273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:30:08.080775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1188/2400] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:30:17.504525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:18.066874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=12 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:41.031160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:30:41.032656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:30:41.047306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5d09-c0bc-41ee-86a0-3632cbea74f0 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:30:41.053058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:30:41.053611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:30:41.053897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:30:41.054183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:30:41.056514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:30:41.131295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:30:41.132940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:30:41.152186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1213/2401] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:30:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:30:51.149445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=36 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:01.478865 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:31:01.487479 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c4f15-43d8-4dc3-99b3-7234c835e8ab service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:31:01.491332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:31:01.491953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:31:01.492231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:31:01.492530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:31:01.494489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:31:01.503958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:31:01.506040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:31:01.514170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1189/2402] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:31:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:31:11.510630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:08.213743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:33:08.215018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:33:08.227589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb1485-ec61-49cc-9f3e-dd4b0fdbbb2c service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:33:08.231230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:33:08.231816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:33:08.232091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:33:08.232362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:33:08.234089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:33:08.301481 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:33:08.302927 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:33:08.320789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1214/2403] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:33:08.368636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:33:08.378821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcdae-e7cc-40f5-b6e2-a4fe148552e7 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:33:08.382393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:33:08.382993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:33:08.383276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:33:08.383554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:33:08.385317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:33:08.407452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:33:08.408913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:33:08.426794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1190/2404] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:33:18.318155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=36 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:18.424123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=14 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:04.421953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:34:04.433923 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ad7a-c644-4b49-bd72-71971a4294ef service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:34:04.438848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:34:04.439453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:34:04.439739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:34:04.440018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:34:04.441782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:34:04.454831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:34:04.456467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:34:04.467800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1215/2405] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:34:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:34:07.776788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:34:07.789897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7ac25-5651-4f39-8d22-b1906c1d64be service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:34:07.795298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:34:07.795900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:34:07.796182 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:34:07.796458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:34:07.798225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:34:07.866177 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:34:07.867755 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:34:07.885783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1191/2406] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:34:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:34:14.464062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:17.883550 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=36 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:07.807701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:07.817184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4559ab-6559-483c-ab73-808993f9814d service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:07.821030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b9e53-cd7e-42a6-ae47-4c044c1de0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:07.821629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b9e53-cd7e-42a6-ae47-4c044c1de0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:07.821920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b9e53-cd7e-42a6-ae47-4c044c1de0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:07.822197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b9e53-cd7e-42a6-ae47-4c044c1de0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:07.832370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b9e53-cd7e-42a6-ae47-4c044c1de0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:07.833820 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b9e53-cd7e-42a6-ae47-4c044c1de0a1 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:07.845204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1216/2407] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:08.798801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:08.808644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413444b4-c34c-4555-ab95-a69b55cf00cf service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:08.812197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:08.812825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:08.813246 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:08.813357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:08.815083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:08.836129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:08.837578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:08.856194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1192/2408] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:08.899426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b9e53-cd7e-42a6-ae47-4c044c1de0a1 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:08.908819 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b9e53-cd7e-42a6-ae47-4c044c1de0a1 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:08.912965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:08.913685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:08.913974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:08.914255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:08.916005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:08.937608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:08.939033 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:08.957801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1217/2409] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:09.087921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:09.096771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016ace-ba54-4ee9-b325-f434cb953204 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:09.100924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:09.101527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:09.102129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:09.102129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:09.103758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:09.172169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:09.173616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:09.192042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1193/2410] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:09.234433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:09.244161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f516f-dff0-4831-9ddd-c91c9913d316 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:09.248253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4195e3-debf-448d-89c5-9c2b4e62ed20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:09.248896 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4195e3-debf-448d-89c5-9c2b4e62ed20 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:09.249179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4195e3-debf-448d-89c5-9c2b4e62ed20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:09.249456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4195e3-debf-448d-89c5-9c2b4e62ed20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:09.257995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4195e3-debf-448d-89c5-9c2b4e62ed20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:09.259421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4195e3-debf-448d-89c5-9c2b4e62ed20 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:09.268524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1218/2411] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:19.189590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=50 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:19.264370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=26 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:40.752995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:40.765322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dd151-2108-481b-b266-e420d3d62e5f service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:40.771342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176537b-6185-47fe-b90b-f454c11b5f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:40.771937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176537b-6185-47fe-b90b-f454c11b5f18 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:40.772213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176537b-6185-47fe-b90b-f454c11b5f18 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:40.772495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176537b-6185-47fe-b90b-f454c11b5f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:40.780546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176537b-6185-47fe-b90b-f454c11b5f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:40.782167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176537b-6185-47fe-b90b-f454c11b5f18 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:40.791974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1194/2412] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:45.392565 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4195e3-debf-448d-89c5-9c2b4e62ed20 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:45.402431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4195e3-debf-448d-89c5-9c2b4e62ed20 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:45.406052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:45.406644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:45.406925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:45.407198 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:45.417475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:45.418894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:45.430075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1219/2413] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:47.050519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176537b-6185-47fe-b90b-f454c11b5f18 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:47.060832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176537b-6185-47fe-b90b-f454c11b5f18 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:47.064435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:47.065071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:47.065354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:47.065625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:47.067360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:47.130803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:47.132217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:47.141652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1195/2414] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:50.121014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:50.122483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:50.134276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9732f-9667-485f-aad8-e040782e2b28 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:50.140770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:50.140770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:50.140770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:50.140770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:50.141283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:50.153557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:50.155068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:50.166265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1220/2415] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:51.113104 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:51.134825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6b02e-44ac-40bf-8373-03bfa9b5f6e4 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:51.156381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:51.156381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:51.156944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:51.157381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:51.159887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:51.174424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:51.176725 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:51.202101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1196/2416] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:56.438789 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:56.450151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f585c2-3462-4eae-bf8f-9cfd4821ab32 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:56.455221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:56.455827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:56.456116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:56.456393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:56.458797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:56.477626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:56.479235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:56.489532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1221/2417] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:35:56.642652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:56.644102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:56.660092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db143e6a-2a50-4ca2-bce1-33f2ac26c3d7 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:56.664406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:56.665081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:56.665361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:56.665658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] PATH_INFO: `/v3/users/578c0a0a8f0544949a4771a651b2ee1e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:56.666901 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578c0a0a8f0544949a4771a651b2ee1e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:56.668890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:56.852764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578c0a0a8f0544949a4771a651b2ee1e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:56.860132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578c0a0a8f0544949a4771a651b2ee1e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:56.875525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578c0a0a8f0544949a4771a651b2ee1e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:56.936954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578c0a0a8f0544949a4771a651b2ee1e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:56.937585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578c0a0a8f0544949a4771a651b2ee1e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:56.943987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1197/2418] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:35:56 2022] DELETE /identity/v3/users/578c0a0a8f0544949a4771a651b2ee1e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:35:57.308225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:57.320991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611e9e-6506-45eb-b549-78d8417c20cf service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:57.397270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:57.398110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:57.398499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:57.398883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] PATH_INFO: `/v3/projects/8b58d25ae1df4454813a0f76db7e4435` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:57.400160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b58d25ae1df4454813a0f76db7e4435)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:57.402253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:57.550805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b58d25ae1df4454813a0f76db7e4435', 'request_id': 'req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:57.557264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b58d25ae1df4454813a0f76db7e4435', 'request_id': 'req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:57.563631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b58d25ae1df4454813a0f76db7e4435', 'request_id': 'req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:57.685037 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] The token cache is being invalidate because project 8b58d25ae1df4454813a0f76db7e4435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:35:57.685330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:57.685977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:57.687477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1222/2419] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:35:57 2022] DELETE /identity/v3/projects/8b58d25ae1df4454813a0f76db7e4435 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:35:57.691540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:57.693133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:57.706555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3430e9-4354-45f8-8b2e-81818e7c0472 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:57.745771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:57.766727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:57.767424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:57.767700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:57.768225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] PATH_INFO: `/v3/users/3fed5d075e284f428bee68330ff204b1` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:57.790458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fed5d075e284f428bee68330ff204b1)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:57.792424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:58.024228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fed5d075e284f428bee68330ff204b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.031743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fed5d075e284f428bee68330ff204b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.046109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fed5d075e284f428bee68330ff204b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.154051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fed5d075e284f428bee68330ff204b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.154695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fed5d075e284f428bee68330ff204b1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.161874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1198/2420] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:35:57 2022] DELETE /identity/v3/users/3fed5d075e284f428bee68330ff204b1 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:35:58.611759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:35:58.614391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:35:58.634730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4d54-6d5d-4261-9f9c-56e6daaa049d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:35:58.711924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:58.725861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:35:58.726595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:35:58.726957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:35:58.727384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] PATH_INFO: `/v3/projects/bce3cdff32bf4ce0a936f7345fc731b1` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:35:58.740587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce3cdff32bf4ce0a936f7345fc731b1)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:35:58.742613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:35:58.862626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce3cdff32bf4ce0a936f7345fc731b1', 'request_id': 'req-03eff737-7983-4de2-8616-1ffd2fdf94c6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.868415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce3cdff32bf4ce0a936f7345fc731b1', 'request_id': 'req-03eff737-7983-4de2-8616-1ffd2fdf94c6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.876551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce3cdff32bf4ce0a936f7345fc731b1', 'request_id': 'req-03eff737-7983-4de2-8616-1ffd2fdf94c6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.955220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] The token cache is being invalidate because project bce3cdff32bf4ce0a936f7345fc731b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:35:58.955220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.955220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:35:58.955220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1223/2421] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:35:58 2022] DELETE /identity/v3/projects/bce3cdff32bf4ce0a936f7345fc731b1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:36:00.084312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:36:00.089508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:36:00.102465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742a67b-c53e-4251-9fb5-4e75c36a5628 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:36:00.159309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:36:00.159874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:36:00.160156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:36:00.160435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] PATH_INFO: `/v3/users/c0121ba668034aac98863a2caf80320e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:36:00.162164 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0121ba668034aac98863a2caf80320e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:36:00.164139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:36:00.373325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0121ba668034aac98863a2caf80320e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:00.375334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:00.380962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0121ba668034aac98863a2caf80320e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:00.392753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0121ba668034aac98863a2caf80320e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:00.506891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0121ba668034aac98863a2caf80320e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:00.507596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0121ba668034aac98863a2caf80320e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:00.513917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1199/2422] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:36:00 2022] DELETE /identity/v3/users/c0121ba668034aac98863a2caf80320e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:36:00.762094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:36:00.763619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:36:00.778291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff737-7983-4de2-8616-1ffd2fdf94c6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:36:00.836172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:36:00.836831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:36:00.837116 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:36:00.837391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] PATH_INFO: `/v3/projects/44cfaa7a9ec843e1a26460270f99a9e2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:36:00.838511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44cfaa7a9ec843e1a26460270f99a9e2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:36:00.840420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:36:00.945010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44cfaa7a9ec843e1a26460270f99a9e2', 'request_id': 'req-44adb975-1839-420e-b70c-f73c65db666a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:00.950840 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44cfaa7a9ec843e1a26460270f99a9e2', 'request_id': 'req-44adb975-1839-420e-b70c-f73c65db666a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:00.957151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44cfaa7a9ec843e1a26460270f99a9e2', 'request_id': 'req-44adb975-1839-420e-b70c-f73c65db666a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:01.072855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] The token cache is being invalidate because project 44cfaa7a9ec843e1a26460270f99a9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:36:01.073197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:01.073837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:01.075720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1224/2423] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:36:00 2022] DELETE /identity/v3/projects/44cfaa7a9ec843e1a26460270f99a9e2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:36:01.079562 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:36:01.081008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:36:01.094216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df754b5-447d-46f3-83e6-0e6e2d596e1e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:36:01.155843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:36:01.156469 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:36:01.156779 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:36:01.157054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] PATH_INFO: `/v3/users/823d8a02fd004fd78f2e7c0cf2981fd4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:36:01.171382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=823d8a02fd004fd78f2e7c0cf2981fd4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:36:01.173368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:36:01.417541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823d8a02fd004fd78f2e7c0cf2981fd4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:01.424558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823d8a02fd004fd78f2e7c0cf2981fd4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:01.436405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823d8a02fd004fd78f2e7c0cf2981fd4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:01.537193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823d8a02fd004fd78f2e7c0cf2981fd4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:01.537837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823d8a02fd004fd78f2e7c0cf2981fd4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:01.544420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1200/2424] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:36:01 2022] DELETE /identity/v3/users/823d8a02fd004fd78f2e7c0cf2981fd4 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:36:01.807673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:36:01.809142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:36:01.817391 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:01.823823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adb975-1839-420e-b70c-f73c65db666a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:36:01.884334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:36:01.884999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:36:01.885283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:36:01.885560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] PATH_INFO: `/v3/projects/085ba2d5f6734aadb838521895b82ec6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:36:01.896581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] RBAC: Authorizing `identity:delete_project(project_id=085ba2d5f6734aadb838521895b82ec6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:36:01.898507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:36:02.024569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085ba2d5f6734aadb838521895b82ec6', 'request_id': 'req-846525d5-923e-480b-85cc-429e08ed227c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:02.030279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085ba2d5f6734aadb838521895b82ec6', 'request_id': 'req-846525d5-923e-480b-85cc-429e08ed227c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:02.037170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085ba2d5f6734aadb838521895b82ec6', 'request_id': 'req-846525d5-923e-480b-85cc-429e08ed227c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:02.125401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] The token cache is being invalidate because project 085ba2d5f6734aadb838521895b82ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:36:02.128827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:02.128827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:36:02.128827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1225/2425] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:36:01 2022] DELETE /identity/v3/projects/085ba2d5f6734aadb838521895b82ec6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:36:05.459130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:36:05.460789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:36:05.502276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:05.563175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9053e-b38c-408f-b1f4-eeb3240a3e10 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:36:05.583303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1806bc-415a-4874-8056-1e8f982bbc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:36:05.584654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1806bc-415a-4874-8056-1e8f982bbc07 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:36:05.584936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1806bc-415a-4874-8056-1e8f982bbc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:36:05.585209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1806bc-415a-4874-8056-1e8f982bbc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:36:05.586982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fa1806bc-415a-4874-8056-1e8f982bbc07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:36:05.598518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1806bc-415a-4874-8056-1e8f982bbc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:36:05.599956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1806bc-415a-4874-8056-1e8f982bbc07 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:36:05.610967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1201/2426] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:36:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:36:12.122034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:15.769361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=35 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:10.007739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:37:10.009900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:37:10.094315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846525d5-923e-480b-85cc-429e08ed227c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:37:10.105092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:37:10.108251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:37:10.108251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:37:10.108251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] PATH_INFO: `/v3/users/0ba6fac98ba44c04ac5b06ae52b35975` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:37:10.108251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba6fac98ba44c04ac5b06ae52b35975)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:37:10.109701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:37:10.303454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba6fac98ba44c04ac5b06ae52b35975'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:10.316313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba6fac98ba44c04ac5b06ae52b35975'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:10.323536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba6fac98ba44c04ac5b06ae52b35975'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:10.380611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba6fac98ba44c04ac5b06ae52b35975'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:10.381245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba6fac98ba44c04ac5b06ae52b35975'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:10.388360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1226/2427] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:37:10 2022] DELETE /identity/v3/users/0ba6fac98ba44c04ac5b06ae52b35975 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:37:10.392882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc269cc2-f7e6-45c1-9bd2-7089e686e374 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:37:10.393388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc269cc2-f7e6-45c1-9bd2-7089e686e374 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:37:10.393498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc269cc2-f7e6-45c1-9bd2-7089e686e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:37:10.414417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fc269cc2-f7e6-45c1-9bd2-7089e686e374 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:37:10.415597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fc269cc2-f7e6-45c1-9bd2-7089e686e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:37:10.473005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1202/2428] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:37:10.482705 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:37:10.484160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:37:10.542149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4228d5-16dc-4441-b407-63942cc529f3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:37:10.545775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:37:10.546379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:37:10.546660 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:37:10.546933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:37:10.556410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:37:10.557855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:37:10.567151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1227/2429] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:37:10.987785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc269cc2-f7e6-45c1-9bd2-7089e686e374 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:37:10.989508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fc269cc2-f7e6-45c1-9bd2-7089e686e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:37:11.003162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc269cc2-f7e6-45c1-9bd2-7089e686e374 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:37:11.009126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:37:11.009845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:37:11.010129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:37:11.010636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] PATH_INFO: `/v3/projects/68b3f55c8c5d4b62bfcd11677216a12f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:37:11.012594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b3f55c8c5d4b62bfcd11677216a12f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:37:11.014985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:37:11.146749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b3f55c8c5d4b62bfcd11677216a12f', 'request_id': 'req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:11.237219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b3f55c8c5d4b62bfcd11677216a12f', 'request_id': 'req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:11.244812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b3f55c8c5d4b62bfcd11677216a12f', 'request_id': 'req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:11.257076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] The token cache is being invalidate because project 68b3f55c8c5d4b62bfcd11677216a12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:37:11.257372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:11.258101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:37:11.259645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1203/2430] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:37:10 2022] DELETE /identity/v3/projects/68b3f55c8c5d4b62bfcd11677216a12f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:37:20.562984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:21.253798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:08.329026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:38:08.330424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:38:08.448188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea173-aacb-4fb4-bc8b-91220bc260e2 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:38:08.510602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:38:08.511957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:38:08.512240 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:38:08.512550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:38:08.514294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:38:08.566072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:08.585277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:38:08.586850 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:38:08.596632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1228/2431] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:38:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:38:18.597150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=10 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:10.346791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:39:10.348206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:39:10.430739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e34b-fd68-4c36-b778-1d5ea541ff5b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:39:10.435217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:39:10.435823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:39:10.436105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:39:10.436382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:39:10.438111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:39:10.510701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:39:10.514953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:39:10.524095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1204/2432] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:39:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:39:12.184349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:39:12.186147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:39:12.280782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f32e96-8205-4b10-8318-99c9e38ee60c service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:39:12.286003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:39:12.286665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:39:12.286947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:39:12.287257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:39:12.289149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:39:12.302834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:39:12.304449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:39:12.320825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1229/2433] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:39:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:39:14.505642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:39:14.507237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:39:14.533088 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01e8e4-5fa8-4bc7-a28f-a7212d3ba128 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:39:14.544064 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:39:14.545048 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:39:14.545530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:39:14.546068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:39:14.548803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:39:14.584656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:39:14.587256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:39:14.610335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1205/2434] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:39:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:39:22.311682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=41 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:24.595312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=70 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:50.027248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:39:50.028716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:39:50.041515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a73b7-e731-45b6-9f55-c7e3e5473a63 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:39:50.045128 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a755c-ea99-4057-80ec-11de125e993a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:39:50.045761 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a755c-ea99-4057-80ec-11de125e993a service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:39:50.046011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a755c-ea99-4057-80ec-11de125e993a service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:39:50.046285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a755c-ea99-4057-80ec-11de125e993a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:39:50.048007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-465a755c-ea99-4057-80ec-11de125e993a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-465a755c-ea99-4057-80ec-11de125e993a service cinder] Could not find project: 8b58d25ae1df4454813a0f76db7e4435.: keystone.exception.ProjectNotFound: Could not find project: 8b58d25ae1df4454813a0f76db7e4435. Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 19 15:39:50.062027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:39:50.063379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._validate_token_resources() Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:39:50.064983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 15:39:50.066479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 15:39:50.067848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8b58d25ae1df4454813a0f76db7e4435. Sep 19 15:39:50.067848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 15:39:50.067848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1230/2435] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:39:50 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 19 15:40:00.051745 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:08.361588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:40:08.363052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:40:08.428371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d937d58-e6ef-4e4b-ab48-ddc42fbcf4dd service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:40:08.432156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:40:08.433153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:40:08.433153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:40:08.433394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:40:08.435733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:40:08.458040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:40:08.459477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:40:08.482456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1206/2436] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:40:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:40:09.009207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a755c-ea99-4057-80ec-11de125e993a service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:40:09.018582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a755c-ea99-4057-80ec-11de125e993a service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:40:09.022149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:40:09.022751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:40:09.023028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:40:09.023297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:40:09.025009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:40:09.098094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:40:09.099525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:40:09.108965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1231/2437] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:40:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:40:09.156069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:40:09.165250 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71ae16-c7d1-4658-8939-23a007acbfe5 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:40:09.170163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:40:09.171309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:40:09.171527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:40:09.171830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:40:09.173572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:40:09.251487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:40:09.253033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:40:09.262994 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1207/2438] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:40:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:40:19.104655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=33 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:19.257850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=70 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:41.814077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:40:41.822563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcd194-c037-4959-8805-35195b62eac4 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:40:41.826369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:40:41.827095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:40:41.827383 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:40:41.827660 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:40:41.829412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:40:41.908746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:40:41.910113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:40:41.928805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1232/2439] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:40:45.228637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:40:45.238754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647c00-a9fd-47cd-b08c-b5959fc7854d service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:40:45.242437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:40:45.243038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:40:45.243316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:40:45.243585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:40:45.245479 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:40:45.259529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:40:45.260700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:40:45.272408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1208/2440] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:40:51.926189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=41 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:55.268152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:10.443107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:41:10.452787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2dabf-a8c1-4e30-98a7-3e7ade9469ef service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:41:10.456614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:41:10.457215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:41:10.457502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:41:10.457781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:41:10.459539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:41:10.469848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:41:10.471358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:41:10.479271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1233/2441] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:41:20.475637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:10.867874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:10.877423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7c5c5-00fe-47ae-98d5-d43396003cfd service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:10.881010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391fcf-7bbe-4930-8d81-be184577fbdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:10.881605 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391fcf-7bbe-4930-8d81-be184577fbdf service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:10.881889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391fcf-7bbe-4930-8d81-be184577fbdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:10.882162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391fcf-7bbe-4930-8d81-be184577fbdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:10.891066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90391fcf-7bbe-4930-8d81-be184577fbdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:10.892473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90391fcf-7bbe-4930-8d81-be184577fbdf service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:10.919757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1209/2442] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:43:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:43:19.172594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:19.174093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:19.185476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6681c-545b-404e-9ffa-21e54d990438 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:19.189353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:19.189993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:19.190290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:19.190601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:19.192327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:19.286738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:19.288324 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:19.311330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1234/2443] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:43:20.916962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=13 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:23.109695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391fcf-7bbe-4930-8d81-be184577fbdf service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:23.122473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391fcf-7bbe-4930-8d81-be184577fbdf service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:23.127887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:23.128615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:23.128992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:23.129353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:23.131113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:23.143879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:23.146707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:23.155604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1210/2444] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:43:23.215453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:23.217066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:23.229185 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7712b-d2de-4553-ac20-95b17adec76a service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:23.234153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:23.234772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:23.235079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:23.235352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] PATH_INFO: `/v3/users/338bde3096e44d81b2157690c75bfa05` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:23.236608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338bde3096e44d81b2157690c75bfa05)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:23.238743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:23.430101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338bde3096e44d81b2157690c75bfa05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:23.443464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338bde3096e44d81b2157690c75bfa05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:23.450671 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338bde3096e44d81b2157690c75bfa05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:23.532902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338bde3096e44d81b2157690c75bfa05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:23.533568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-254dec83-c35c-427b-9ab0-c8d427e3b670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338bde3096e44d81b2157690c75bfa05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:23.540282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1235/2445] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:43:23 2022] DELETE /identity/v3/users/338bde3096e44d81b2157690c75bfa05 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:43:23.862935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:23.874112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caadb-ebcf-4e56-ad01-93fda3e0eb02 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:23.934338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:23.935162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:23.935447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:23.935721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] PATH_INFO: `/v3/projects/677200be9d434857877c452db7ad4b20` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:23.936899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=677200be9d434857877c452db7ad4b20)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:23.938790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:24.099417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677200be9d434857877c452db7ad4b20', 'request_id': 'req-0c805d0e-621a-49d8-a87d-e891b4762d30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:24.167079 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677200be9d434857877c452db7ad4b20', 'request_id': 'req-0c805d0e-621a-49d8-a87d-e891b4762d30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:24.173720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677200be9d434857877c452db7ad4b20', 'request_id': 'req-0c805d0e-621a-49d8-a87d-e891b4762d30'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:24.187635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] The token cache is being invalidate because project 677200be9d434857877c452db7ad4b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:43:24.187635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:24.187635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0c805d0e-621a-49d8-a87d-e891b4762d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:43:24.187635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1211/2446] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:43:23 2022] DELETE /identity/v3/projects/677200be9d434857877c452db7ad4b20 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:43:24.197880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c17e1-7313-47ab-83d5-72c4a746e6fa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.198166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c17e1-7313-47ab-83d5-72c4a746e6fa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.198442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c17e1-7313-47ab-83d5-72c4a746e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.254494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:24.267775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1e4c17e1-7313-47ab-83d5-72c4a746e6fa None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:43:24.267775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1e4c17e1-7313-47ab-83d5-72c4a746e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:24.316861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1236/2447] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:43:24.325544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb39c-a3e3-4dc8-854a-9c5d3d587b43 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.325853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb39c-a3e3-4dc8-854a-9c5d3d587b43 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.326085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb39c-a3e3-4dc8-854a-9c5d3d587b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.346379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3f9fb39c-a3e3-4dc8-854a-9c5d3d587b43 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:43:24.347695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3f9fb39c-a3e3-4dc8-854a-9c5d3d587b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:24.355805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1212/2448] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:43:24.360356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c17e1-7313-47ab-83d5-72c4a746e6fa None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:24.370747 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c17e1-7313-47ab-83d5-72c4a746e6fa None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:24.376123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:24.376618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.376903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.377201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.377828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:43:24.378133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:24.379735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:24.392340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1237/2449] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:43:24.396549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb39c-a3e3-4dc8-854a-9c5d3d587b43 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:24.407195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb39c-a3e3-4dc8-854a-9c5d3d587b43 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:24.411913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad8c21-40f9-448d-8c7d-8b4e511ca748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:24.412538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8c21-40f9-448d-8c7d-8b4e511ca748 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.412819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8c21-40f9-448d-8c7d-8b4e511ca748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.413092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8c21-40f9-448d-8c7d-8b4e511ca748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.413729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad8c21-40f9-448d-8c7d-8b4e511ca748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:24.415644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad8c21-40f9-448d-8c7d-8b4e511ca748 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:24.506210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1213/2450] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:43:24 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:43:24.510577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:24.521880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d4c6-f479-4062-a7f7-642cec8d9f0f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:24.578319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218aae-066e-4a97-9a5b-ed8247762da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:24.578922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218aae-066e-4a97-9a5b-ed8247762da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.579199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218aae-066e-4a97-9a5b-ed8247762da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.579468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218aae-066e-4a97-9a5b-ed8247762da1 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.580098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218aae-066e-4a97-9a5b-ed8247762da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:24.582031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218aae-066e-4a97-9a5b-ed8247762da1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:24.688256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1238/2451] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:43:24 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:43:24.692417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad8c21-40f9-448d-8c7d-8b4e511ca748 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:24.703730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad8c21-40f9-448d-8c7d-8b4e511ca748 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:24.708453 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556798de-a33d-46dc-90e4-78eb6e8d44d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:24.709000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556798de-a33d-46dc-90e4-78eb6e8d44d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.709319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556798de-a33d-46dc-90e4-78eb6e8d44d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.709560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556798de-a33d-46dc-90e4-78eb6e8d44d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.710231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556798de-a33d-46dc-90e4-78eb6e8d44d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:24.711812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556798de-a33d-46dc-90e4-78eb6e8d44d0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:24.721693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1214/2452] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:43:24.725677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218aae-066e-4a97-9a5b-ed8247762da1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:24.735834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218aae-066e-4a97-9a5b-ed8247762da1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:24.740591 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385b1be-220b-4a67-bccc-4b8576d77970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:24.741195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385b1be-220b-4a67-bccc-4b8576d77970 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.741477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385b1be-220b-4a67-bccc-4b8576d77970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.741753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385b1be-220b-4a67-bccc-4b8576d77970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.742481 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385b1be-220b-4a67-bccc-4b8576d77970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:24.744070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385b1be-220b-4a67-bccc-4b8576d77970 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:24.755739 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1239/2453] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:43:24.759861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556798de-a33d-46dc-90e4-78eb6e8d44d0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:24.770498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556798de-a33d-46dc-90e4-78eb6e8d44d0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:24.775172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14469221-5eed-4ef2-96c5-3c6645b386f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:24.775828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469221-5eed-4ef2-96c5-3c6645b386f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.776110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469221-5eed-4ef2-96c5-3c6645b386f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.776390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469221-5eed-4ef2-96c5-3c6645b386f8 admin admin] PATH_INFO: `/v3/projects/b5529cbfa2f44788b75c75608659b30f/users/9dbfb2288e1049839b4545a2ad16446c/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.791275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14469221-5eed-4ef2-96c5-3c6645b386f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5529cbfa2f44788b75c75608659b30f, user_id=9dbfb2288e1049839b4545a2ad16446c, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:24.794187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14469221-5eed-4ef2-96c5-3c6645b386f8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:24.893187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1215/2454] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:43:24 2022] PUT /identity/v3/projects/b5529cbfa2f44788b75c75608659b30f/users/9dbfb2288e1049839b4545a2ad16446c/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:43:24.905721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c102-3ef4-4f6f-af46-c61f8fe06c0e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:24.906108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c102-3ef4-4f6f-af46-c61f8fe06c0e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:24.906388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c102-3ef4-4f6f-af46-c61f8fe06c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:24.938179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a1f0c102-3ef4-4f6f-af46-c61f8fe06c0e None None] MFA Rules not processed for user `9dbfb2288e1049839b4545a2ad16446c`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:43:24.939456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a1f0c102-3ef4-4f6f-af46-c61f8fe06c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:25.004310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1240/2455] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:43:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:43:25.009014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14469221-5eed-4ef2-96c5-3c6645b386f8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:25.014934 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:25.084631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14469221-5eed-4ef2-96c5-3c6645b386f8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:25.089357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac09de-d1d4-4119-8bdb-e13bd19b8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:25.089969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac09de-d1d4-4119-8bdb-e13bd19b8da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:25.090252 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac09de-d1d4-4119-8bdb-e13bd19b8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:25.090529 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac09de-d1d4-4119-8bdb-e13bd19b8da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:25.091157 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac09de-d1d4-4119-8bdb-e13bd19b8da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:25.093097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac09de-d1d4-4119-8bdb-e13bd19b8da6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:25.203213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1216/2456] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:43:25 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:43:25.207279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0c102-3ef4-4f6f-af46-c61f8fe06c0e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:25.213217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:25.219903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0c102-3ef4-4f6f-af46-c61f8fe06c0e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:25.277595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b0b86-3b47-44eb-bfcc-2b78d445b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:25.278985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0b86-3b47-44eb-bfcc-2b78d445b4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:25.279359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0b86-3b47-44eb-bfcc-2b78d445b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:25.279734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0b86-3b47-44eb-bfcc-2b78d445b4f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:25.280330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b0b86-3b47-44eb-bfcc-2b78d445b4f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:25.282328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b0b86-3b47-44eb-bfcc-2b78d445b4f7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:25.352735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1241/2457] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:43:25 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:43:25.357771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac09de-d1d4-4119-8bdb-e13bd19b8da6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:25.368264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac09de-d1d4-4119-8bdb-e13bd19b8da6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:25.373797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4286b17-6bd1-4c14-927f-fb5de55520a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:25.374394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4286b17-6bd1-4c14-927f-fb5de55520a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:25.374676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4286b17-6bd1-4c14-927f-fb5de55520a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:25.374956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4286b17-6bd1-4c14-927f-fb5de55520a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:25.375587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4286b17-6bd1-4c14-927f-fb5de55520a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:25.377219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4286b17-6bd1-4c14-927f-fb5de55520a7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:25.388140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1217/2458] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:43:25.392080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b0b86-3b47-44eb-bfcc-2b78d445b4f7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:25.402134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b0b86-3b47-44eb-bfcc-2b78d445b4f7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:25.409050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe5d8-9db3-4d81-9c2c-ac18d02926aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:25.409880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe5d8-9db3-4d81-9c2c-ac18d02926aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:25.410163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe5d8-9db3-4d81-9c2c-ac18d02926aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:25.411419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe5d8-9db3-4d81-9c2c-ac18d02926aa admin admin] PATH_INFO: `/v3/projects/2673ec0bc91d4d3890613c069b39e76a/users/7ef2471c79194f208b7bc4f7c9fe8342/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:25.427804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe5d8-9db3-4d81-9c2c-ac18d02926aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2673ec0bc91d4d3890613c069b39e76a, user_id=7ef2471c79194f208b7bc4f7c9fe8342, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:25.430530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe5d8-9db3-4d81-9c2c-ac18d02926aa admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:25.499274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1242/2459] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:43:25 2022] PUT /identity/v3/projects/2673ec0bc91d4d3890613c069b39e76a/users/7ef2471c79194f208b7bc4f7c9fe8342/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:43:25.503222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4286b17-6bd1-4c14-927f-fb5de55520a7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:25.513486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4286b17-6bd1-4c14-927f-fb5de55520a7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:25.570394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd16f8-5d36-4d90-b047-623e849d6c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:25.570989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd16f8-5d36-4d90-b047-623e849d6c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:25.571271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd16f8-5d36-4d90-b047-623e849d6c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:25.571540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd16f8-5d36-4d90-b047-623e849d6c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:25.572163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd16f8-5d36-4d90-b047-623e849d6c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:25.573766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd16f8-5d36-4d90-b047-623e849d6c33 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:25.584180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1218/2460] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:43:25.588615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe5d8-9db3-4d81-9c2c-ac18d02926aa admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:25.599000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe5d8-9db3-4d81-9c2c-ac18d02926aa admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:25.603559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:25.604196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:25.604472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:25.604846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] PATH_INFO: `/v3/projects/2673ec0bc91d4d3890613c069b39e76a/users/7ef2471c79194f208b7bc4f7c9fe8342/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:25.607376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2673ec0bc91d4d3890613c069b39e76a, user_id=7ef2471c79194f208b7bc4f7c9fe8342, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:25.610021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:25.620398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1243/2461] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:43:25 2022] PUT /identity/v3/projects/2673ec0bc91d4d3890613c069b39e76a/users/7ef2471c79194f208b7bc4f7c9fe8342/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:43:25.631301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a46-4fd1-4db2-bc8b-081f98fad078 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:25.631594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a46-4fd1-4db2-bc8b-081f98fad078 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:25.631874 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a46-4fd1-4db2-bc8b-081f98fad078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:25.659636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0c990a46-4fd1-4db2-bc8b-081f98fad078 None None] MFA Rules not processed for user `7ef2471c79194f208b7bc4f7c9fe8342`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:43:25.664188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c990a46-4fd1-4db2-bc8b-081f98fad078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:25.729793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:25.733935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1219/2462] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:43:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:43:35.616674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=43,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:52.847493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:43:52.849252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:43:52.905227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ff14a-8891-4c3c-87f2-91d177bf48d5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:43:52.909420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:43:52.910008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:43:52.910290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:43:52.910561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:43:52.919195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:43:52.920635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:43:52.930937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1244/2463] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:44:02.926589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=26 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:18.689176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c990a46-4fd1-4db2-bc8b-081f98fad078 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:44:18.690578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c990a46-4fd1-4db2-bc8b-081f98fad078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:44:18.759995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c990a46-4fd1-4db2-bc8b-081f98fad078 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:44:18.764988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:44:18.765596 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:44:18.766486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:44:18.766996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:44:18.768867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:44:18.780215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:44:18.782198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:44:18.791979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1220/2464] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:44:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:44:28.787810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=32 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:07.904610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:07.906092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:07.961906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bb870-791b-40c5-bb12-42c0b80796e3 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:07.965418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:07.966006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:07.966281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:07.966549 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:07.968273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:08.039383 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:08.040790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:08.052180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1245/2465] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:11.396146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:11.397738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:11.409863 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476528-12e5-44e2-9420-bec285121238 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:11.413769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:11.414276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:11.414682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:11.414961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:11.416723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:11.486362 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:11.487864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:11.507116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1221/2466] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:11.550990 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:11.560715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ada-48da-4f40-bc5e-92db7dea3f4c service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:11.564269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:11.564895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:11.565173 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:11.565443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:11.567158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:11.637047 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:11.638492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:11.656581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1246/2467] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:21.504464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=36 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:21.654022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:40.689848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:40.766687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d97e0-08e0-45cc-802b-df8a04512608 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:40.771747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:40.780740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:40.780740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:40.780740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] PATH_INFO: `/v3/users/9dbfb2288e1049839b4545a2ad16446c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:40.781663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbfb2288e1049839b4545a2ad16446c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:40.783704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:40.944654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:40.946136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:41.033807 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972dd9-7dec-4704-a2c6-be4433e55097 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:41.038751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da28b71-2cc2-42cb-8972-b8464799b33b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa1d30decad84c7081c7e150812b2964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:41.039436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da28b71-2cc2-42cb-8972-b8464799b33b service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:41.039910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da28b71-2cc2-42cb-8972-b8464799b33b service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:41.040257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da28b71-2cc2-42cb-8972-b8464799b33b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:41.042331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4da28b71-2cc2-42cb-8972-b8464799b33b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4da28b71-2cc2-42cb-8972-b8464799b33b service glance] Could not find project: a1e1cd72bc58473cad31e4887602deed.: keystone.exception.ProjectNotFound: Could not find project: a1e1cd72bc58473cad31e4887602deed. Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 19 15:45:41.057902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:45:41.059766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._validate_token_resources() Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 15:45:41.061251 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 15:45:41.062642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 15:45:41.064291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a1e1cd72bc58473cad31e4887602deed. Sep 19 15:45:41.064291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 19 15:45:41.064291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1247/2468] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:40 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 19 15:45:41.072745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbfb2288e1049839b4545a2ad16446c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:41.080178 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbfb2288e1049839b4545a2ad16446c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:41.093872 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbfb2288e1049839b4545a2ad16446c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:41.179885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbfb2288e1049839b4545a2ad16446c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:41.180853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbfb2288e1049839b4545a2ad16446c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:41.193389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1222/2469] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:45:40 2022] DELETE /identity/v3/users/9dbfb2288e1049839b4545a2ad16446c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:41.193644 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a760-ddf1-4fa6-85ab-520cedfd02df None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:41.194610 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a760-ddf1-4fa6-85ab-520cedfd02df None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:41.194957 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348a760-ddf1-4fa6-85ab-520cedfd02df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:41.217295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6348a760-ddf1-4fa6-85ab-520cedfd02df None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:41.218699 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6348a760-ddf1-4fa6-85ab-520cedfd02df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:41.311102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1248/2470] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:41.321290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:41.322714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:41.385130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a539d-8c70-4b1e-92b7-f39feb056062 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:41.388875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb0d1-a842-4ba8-8df8-9eee1815f871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:41.389476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb0d1-a842-4ba8-8df8-9eee1815f871 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:41.389758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb0d1-a842-4ba8-8df8-9eee1815f871 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:41.390029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb0d1-a842-4ba8-8df8-9eee1815f871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:41.400215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fb0d1-a842-4ba8-8df8-9eee1815f871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:41.401717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fb0d1-a842-4ba8-8df8-9eee1815f871 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:41.415203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1223/2471] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:41.838781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348a760-ddf1-4fa6-85ab-520cedfd02df None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:41.843833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6348a760-ddf1-4fa6-85ab-520cedfd02df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:41.855165 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348a760-ddf1-4fa6-85ab-520cedfd02df None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:41.860141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:41.860926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:41.861320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:41.861785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] PATH_INFO: `/v3/projects/b5529cbfa2f44788b75c75608659b30f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:41.863264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5529cbfa2f44788b75c75608659b30f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:41.866621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:42.008734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5529cbfa2f44788b75c75608659b30f', 'request_id': 'req-659771e0-e2cc-4882-ba23-68f5ea53f7e1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.014474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5529cbfa2f44788b75c75608659b30f', 'request_id': 'req-659771e0-e2cc-4882-ba23-68f5ea53f7e1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.020692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5529cbfa2f44788b75c75608659b30f', 'request_id': 'req-659771e0-e2cc-4882-ba23-68f5ea53f7e1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.105834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] The token cache is being invalidate because project b5529cbfa2f44788b75c75608659b30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:45:42.106072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.106682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.108181 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1249/2472] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:45:41 2022] DELETE /identity/v3/projects/b5529cbfa2f44788b75c75608659b30f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:42.112284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb0d1-a842-4ba8-8df8-9eee1815f871 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:42.122149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb0d1-a842-4ba8-8df8-9eee1815f871 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:42.141416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:42.181265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:42.182000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:42.182280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:42.182559 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] PATH_INFO: `/v3/users/7ef2471c79194f208b7bc4f7c9fe8342` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:42.183838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef2471c79194f208b7bc4f7c9fe8342)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:42.185970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:42.317476 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:42.318869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:42.333403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:42.372591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef2471c79194f208b7bc4f7c9fe8342'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.380948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef2471c79194f208b7bc4f7c9fe8342'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.395952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef2471c79194f208b7bc4f7c9fe8342'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.401510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659771e0-e2cc-4882-ba23-68f5ea53f7e1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:42.407571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:42.408215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:42.408523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:42.408803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:42.410613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:42.471480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:42.473199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:42.483211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1250/2473] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:42.486102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef2471c79194f208b7bc4f7c9fe8342'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.486102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef2471c79194f208b7bc4f7c9fe8342'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:42.492221 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1224/2474] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:45:42 2022] DELETE /identity/v3/users/7ef2471c79194f208b7bc4f7c9fe8342 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:42.695322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:42.706475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f07e0-07a7-48a5-aa46-99fa11d3a44f service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:42.784418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779d53-3f7d-489f-b237-11b42c9c43d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:42.785058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779d53-3f7d-489f-b237-11b42c9c43d4 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:42.785339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779d53-3f7d-489f-b237-11b42c9c43d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:42.785643 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779d53-3f7d-489f-b237-11b42c9c43d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:42.787414 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7d779d53-3f7d-489f-b237-11b42c9c43d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:42.800706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779d53-3f7d-489f-b237-11b42c9c43d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:42.802311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779d53-3f7d-489f-b237-11b42c9c43d4 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:42.814172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1251/2475] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:42.947706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:42.947706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:43.009552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee08b9-b54a-4d89-b69b-6673fecd71e5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:43.014136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:43.014776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.015062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.015337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] PATH_INFO: `/v3/projects/2673ec0bc91d4d3890613c069b39e76a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.016468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2673ec0bc91d4d3890613c069b39e76a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:43.018388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:43.171023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:43.174590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2673ec0bc91d4d3890613c069b39e76a', 'request_id': 'req-824b60f9-dfc9-4d4f-8f2c-5218532593c9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:43.230517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2673ec0bc91d4d3890613c069b39e76a', 'request_id': 'req-824b60f9-dfc9-4d4f-8f2c-5218532593c9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:43.237078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2673ec0bc91d4d3890613c069b39e76a', 'request_id': 'req-824b60f9-dfc9-4d4f-8f2c-5218532593c9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:43.248335 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] The token cache is being invalidate because project 2673ec0bc91d4d3890613c069b39e76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:45:43.248666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:43.249310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-824b60f9-dfc9-4d4f-8f2c-5218532593c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:43.251092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1225/2476] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:45:42 2022] DELETE /identity/v3/projects/2673ec0bc91d4d3890613c069b39e76a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:43.255996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7fed-6c7f-4aec-97b1-db42562bbdea None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.257467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7fed-6c7f-4aec-97b1-db42562bbdea None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.257467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7fed-6c7f-4aec-97b1-db42562bbdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.275617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dc0d7fed-6c7f-4aec-97b1-db42562bbdea None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:43.276824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dc0d7fed-6c7f-4aec-97b1-db42562bbdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:43.308796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:43.338746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1252/2477] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:43.346387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de219-8d4c-4315-8084-9bed8f8cf2b0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.346676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de219-8d4c-4315-8084-9bed8f8cf2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.346952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de219-8d4c-4315-8084-9bed8f8cf2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.367709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9f6de219-8d4c-4315-8084-9bed8f8cf2b0 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:43.368952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9f6de219-8d4c-4315-8084-9bed8f8cf2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:43.377192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1226/2478] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:43.382415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7fed-6c7f-4aec-97b1-db42562bbdea None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:43.391848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7fed-6c7f-4aec-97b1-db42562bbdea None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:43.396332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:43.396953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.397774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.398024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.398828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:45:43.399129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:43.400736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:43.412595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1253/2479] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:45:43.416966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6de219-8d4c-4315-8084-9bed8f8cf2b0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:43.426058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6de219-8d4c-4315-8084-9bed8f8cf2b0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:43.430634 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefb508-6594-46f2-b7dc-221453fadb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:43.431222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefb508-6594-46f2-b7dc-221453fadb58 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.431498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefb508-6594-46f2-b7dc-221453fadb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.431768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefb508-6594-46f2-b7dc-221453fadb58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.432401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefb508-6594-46f2-b7dc-221453fadb58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:43.434294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefb508-6594-46f2-b7dc-221453fadb58 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:43.555209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1227/2480] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:45:43 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:43.556616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:43.567032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96038f7-5777-4baa-9178-126fb07e986e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:43.623541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a1fc-9ea6-4978-86ca-88a8e9733719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:43.624171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a1fc-9ea6-4978-86ca-88a8e9733719 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.624449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a1fc-9ea6-4978-86ca-88a8e9733719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.624742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a1fc-9ea6-4978-86ca-88a8e9733719 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.625374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a1fc-9ea6-4978-86ca-88a8e9733719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:43.627552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a1fc-9ea6-4978-86ca-88a8e9733719 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:43.709340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1254/2481] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:45:43 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:45:43.711458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefb508-6594-46f2-b7dc-221453fadb58 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:43.722098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefb508-6594-46f2-b7dc-221453fadb58 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:43.727089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464cb04-6f43-4d00-9bc5-62d12441aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:43.727696 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464cb04-6f43-4d00-9bc5-62d12441aaed admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.727977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464cb04-6f43-4d00-9bc5-62d12441aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.728253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464cb04-6f43-4d00-9bc5-62d12441aaed admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.728937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464cb04-6f43-4d00-9bc5-62d12441aaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:43.730647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464cb04-6f43-4d00-9bc5-62d12441aaed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:43.742046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1228/2482] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:43.744947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a1fc-9ea6-4978-86ca-88a8e9733719 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:43.758178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a1fc-9ea6-4978-86ca-88a8e9733719 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:43.764139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a88d6-ed83-44df-879e-58d24fdfd218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:43.764791 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a88d6-ed83-44df-879e-58d24fdfd218 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.765083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a88d6-ed83-44df-879e-58d24fdfd218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.765361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a88d6-ed83-44df-879e-58d24fdfd218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.766025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a88d6-ed83-44df-879e-58d24fdfd218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:43.767605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a88d6-ed83-44df-879e-58d24fdfd218 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:43.792959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1255/2483] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:43.797476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464cb04-6f43-4d00-9bc5-62d12441aaed admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:43.812007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464cb04-6f43-4d00-9bc5-62d12441aaed admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:43.817125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9ebf-4fa2-47f1-8180-465369a4ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:43.817855 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9ebf-4fa2-47f1-8180-465369a4ade8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.818161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9ebf-4fa2-47f1-8180-465369a4ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.818441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9ebf-4fa2-47f1-8180-465369a4ade8 admin admin] PATH_INFO: `/v3/projects/bbe347ba7ade440aa5fba099e47b50da/users/90e09766b16f489c8c840585b88a6526/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.834222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9ebf-4fa2-47f1-8180-465369a4ade8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe347ba7ade440aa5fba099e47b50da, user_id=90e09766b16f489c8c840585b88a6526, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:43.837830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9ebf-4fa2-47f1-8180-465369a4ade8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:43.935384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1229/2484] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:45:43 2022] PUT /identity/v3/projects/bbe347ba7ade440aa5fba099e47b50da/users/90e09766b16f489c8c840585b88a6526/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:43.947188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c449-5583-45f1-adce-c4a415280a5e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:43.947439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c449-5583-45f1-adce-c4a415280a5e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:43.947703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c449-5583-45f1-adce-c4a415280a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:43.992390 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f136c449-5583-45f1-adce-c4a415280a5e None None] MFA Rules not processed for user `90e09766b16f489c8c840585b88a6526`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:43.993658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f136c449-5583-45f1-adce-c4a415280a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:44.078178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1256/2485] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:44.082988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9ebf-4fa2-47f1-8180-465369a4ade8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:44.148838 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9ebf-4fa2-47f1-8180-465369a4ade8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:44.153709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8ff11-188b-497d-bf86-3284e2401809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:44.154361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8ff11-188b-497d-bf86-3284e2401809 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:44.154591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8ff11-188b-497d-bf86-3284e2401809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:44.154864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8ff11-188b-497d-bf86-3284e2401809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:44.155645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8ff11-188b-497d-bf86-3284e2401809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:44.157432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8ff11-188b-497d-bf86-3284e2401809 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:44.235526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1230/2486] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:45:44 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:44.237400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136c449-5583-45f1-adce-c4a415280a5e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:44.249177 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136c449-5583-45f1-adce-c4a415280a5e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:44.277960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:44.309329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850b8b0-9f43-4be6-946a-70d702664890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:44.309941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850b8b0-9f43-4be6-946a-70d702664890 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:44.310218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850b8b0-9f43-4be6-946a-70d702664890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:44.310504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850b8b0-9f43-4be6-946a-70d702664890 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:44.311137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850b8b0-9f43-4be6-946a-70d702664890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:44.313328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850b8b0-9f43-4be6-946a-70d702664890 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:44.402946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1257/2487] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:45:44 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:45:44.407072 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8ff11-188b-497d-bf86-3284e2401809 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:44.418325 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8ff11-188b-497d-bf86-3284e2401809 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:44.423554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cddcad-77fe-4574-99c9-f6aa82aeb328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:44.424158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cddcad-77fe-4574-99c9-f6aa82aeb328 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:44.425618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cddcad-77fe-4574-99c9-f6aa82aeb328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:44.425618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cddcad-77fe-4574-99c9-f6aa82aeb328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:44.425618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cddcad-77fe-4574-99c9-f6aa82aeb328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:44.427083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cddcad-77fe-4574-99c9-f6aa82aeb328 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:44.439384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1231/2488] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:44.443633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850b8b0-9f43-4be6-946a-70d702664890 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:44.454490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850b8b0-9f43-4be6-946a-70d702664890 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:44.459213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6b776-5841-4579-b348-1fbcf2dd2638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:44.459942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b776-5841-4579-b348-1fbcf2dd2638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:44.460233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b776-5841-4579-b348-1fbcf2dd2638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:44.460539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b776-5841-4579-b348-1fbcf2dd2638 admin admin] PATH_INFO: `/v3/projects/6510a0a48f3942598e639fea062fae80/users/f1e6d77864ca40b7ba41c0accd0a7851/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:44.476595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6b776-5841-4579-b348-1fbcf2dd2638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6510a0a48f3942598e639fea062fae80, user_id=f1e6d77864ca40b7ba41c0accd0a7851, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:44.479472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6b776-5841-4579-b348-1fbcf2dd2638 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:44.545899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1258/2489] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:45:44 2022] PUT /identity/v3/projects/6510a0a48f3942598e639fea062fae80/users/f1e6d77864ca40b7ba41c0accd0a7851/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:45:44.550111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cddcad-77fe-4574-99c9-f6aa82aeb328 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:44.561132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cddcad-77fe-4574-99c9-f6aa82aeb328 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:44.605054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:44.622400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae4757-7fbd-45dc-a857-94ecb7d0823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:44.623021 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae4757-7fbd-45dc-a857-94ecb7d0823f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:44.623301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae4757-7fbd-45dc-a857-94ecb7d0823f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:44.623573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae4757-7fbd-45dc-a857-94ecb7d0823f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:44.624223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae4757-7fbd-45dc-a857-94ecb7d0823f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:44.626126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae4757-7fbd-45dc-a857-94ecb7d0823f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:44.649501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1232/2490] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:44.652410 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6b776-5841-4579-b348-1fbcf2dd2638 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:44.666179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6b776-5841-4579-b348-1fbcf2dd2638 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:44.671392 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:44.672069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:44.672320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:44.672618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] PATH_INFO: `/v3/projects/6510a0a48f3942598e639fea062fae80/users/f1e6d77864ca40b7ba41c0accd0a7851/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:44.674572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6510a0a48f3942598e639fea062fae80, user_id=f1e6d77864ca40b7ba41c0accd0a7851, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:44.677352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:44.688237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1259/2491] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:45:44 2022] PUT /identity/v3/projects/6510a0a48f3942598e639fea062fae80/users/f1e6d77864ca40b7ba41c0accd0a7851/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:44.698461 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998f5c-d2e1-4a2e-a826-4de89bec24b6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:44.698740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998f5c-d2e1-4a2e-a826-4de89bec24b6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:44.699007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998f5c-d2e1-4a2e-a826-4de89bec24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:44.726835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-69998f5c-d2e1-4a2e-a826-4de89bec24b6 None None] MFA Rules not processed for user `f1e6d77864ca40b7ba41c0accd0a7851`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:44.728034 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-69998f5c-d2e1-4a2e-a826-4de89bec24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:44.798982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1233/2492] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:44.811710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:44.813412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:44.871575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c098e-3591-48a8-a2d4-6a0fdb49df7a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:44.875208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c8a29-6fbd-4202-b81c-d598aafca437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:44.876184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c8a29-6fbd-4202-b81c-d598aafca437 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:44.876462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c8a29-6fbd-4202-b81c-d598aafca437 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:44.876763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c8a29-6fbd-4202-b81c-d598aafca437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:44.885726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c8a29-6fbd-4202-b81c-d598aafca437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:44.887267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c8a29-6fbd-4202-b81c-d598aafca437 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:44.896386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1260/2493] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:45.729797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69998f5c-d2e1-4a2e-a826-4de89bec24b6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:45.739029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69998f5c-d2e1-4a2e-a826-4de89bec24b6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:45.743666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e6d77864ca40b7ba41c0accd0a7851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6510a0a48f3942598e639fea062fae80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:45.744272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:45.744577 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:45.744880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:45.745546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:45:45.745830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:45.747408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:45.760963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1234/2494] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:45:45.766112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c8a29-6fbd-4202-b81c-d598aafca437 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:45.776960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c8a29-6fbd-4202-b81c-d598aafca437 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:45.781877 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ecb7f-7ccd-4fd7-a2fe-226510286d4c tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e6d77864ca40b7ba41c0accd0a7851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6510a0a48f3942598e639fea062fae80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:45.782492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ecb7f-7ccd-4fd7-a2fe-226510286d4c tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:45.782778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ecb7f-7ccd-4fd7-a2fe-226510286d4c tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:45.783052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ecb7f-7ccd-4fd7-a2fe-226510286d4c tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:45.783698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ecb7f-7ccd-4fd7-a2fe-226510286d4c tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:45.785632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ecb7f-7ccd-4fd7-a2fe-226510286d4c tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:45.850188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1261/2495] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:45:45 2022] POST /identity/v3/projects => generated 355 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:45.855181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:45.865276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b61c6-23ca-44c2-9591-32f42acc77b0 tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:45.923150 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e6d77864ca40b7ba41c0accd0a7851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6510a0a48f3942598e639fea062fae80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:45.923881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:45.924217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:45.924594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:45.929831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:45:45.929831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:45.929831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:45.940509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1235/2496] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:45:45.978297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ecb7f-7ccd-4fd7-a2fe-226510286d4c tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:45.988854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ecb7f-7ccd-4fd7-a2fe-226510286d4c tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:45.995087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e6d77864ca40b7ba41c0accd0a7851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6510a0a48f3942598e639fea062fae80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:45.995087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:45.995087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:45.995576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] PATH_INFO: `/v3/projects/31b374e8ac7d48b5b4e45dc696ac42b5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:45.996439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Authorizing `identity:delete_project(project_id=31b374e8ac7d48b5b4e45dc696ac42b5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:45.998420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:46.127533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b374e8ac7d48b5b4e45dc696ac42b5', 'request_id': 'req-75c5897d-03ea-4be6-9a81-4e4fe037843f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:46.148525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:46.150337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b374e8ac7d48b5b4e45dc696ac42b5', 'request_id': 'req-75c5897d-03ea-4be6-9a81-4e4fe037843f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:46.157522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b374e8ac7d48b5b4e45dc696ac42b5', 'request_id': 'req-75c5897d-03ea-4be6-9a81-4e4fe037843f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:46.243098 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] The token cache is being invalidate because project 31b374e8ac7d48b5b4e45dc696ac42b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:45:46.249264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:46.249264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-75c5897d-03ea-4be6-9a81-4e4fe037843f tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:46.249264 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1262/2497] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:45:45 2022] DELETE /identity/v3/projects/31b374e8ac7d48b5b4e45dc696ac42b5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:47.013283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:47.015025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:47.064697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:47.082672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072cccc-103f-42d4-90dc-c8541e9db7fb tempest-VolumeQuotaClassesTest-1605184311 tempest-VolumeQuotaClassesTest-1605184311-project-admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:47.150735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:47.151667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:47.151775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:47.152232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] PATH_INFO: `/v3/users/90e09766b16f489c8c840585b88a6526` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:47.153747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e09766b16f489c8c840585b88a6526)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:47.158561 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:47.318877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e09766b16f489c8c840585b88a6526'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:47.326963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e09766b16f489c8c840585b88a6526'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:47.340418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e09766b16f489c8c840585b88a6526'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:47.431665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e09766b16f489c8c840585b88a6526'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:47.431665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e09766b16f489c8c840585b88a6526'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:47.435618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1236/2498] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:45:47 2022] DELETE /identity/v3/users/90e09766b16f489c8c840585b88a6526 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:45:47.439851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e720-753a-4c10-a3af-e620a804197a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:47.440439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e720-753a-4c10-a3af-e620a804197a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:47.440439 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e720-753a-4c10-a3af-e620a804197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:47.460683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2320e720-753a-4c10-a3af-e620a804197a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:47.461967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2320e720-753a-4c10-a3af-e620a804197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:47.523580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1263/2499] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:47.538819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:47.543643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:47.600776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8db93-4252-4215-909e-f837bd9d0776 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:47.604439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:47.605090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:47.605372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:47.605645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:47.615066 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:47.616523 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:47.626614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1237/2500] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:47.844818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49c79-28b5-419c-8cfd-6ceda37c683b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:47.845192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49c79-28b5-419c-8cfd-6ceda37c683b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:47.845563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49c79-28b5-419c-8cfd-6ceda37c683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:47.874895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fbd49c79-28b5-419c-8cfd-6ceda37c683b None None] MFA Rules not processed for user `fb7200a9769b46b3a79c9fe6287a1724`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:47.876310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fbd49c79-28b5-419c-8cfd-6ceda37c683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:47.938660 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1264/2501] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:48.020319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:48.021794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:48.047109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e611-38c8-49c4-bee2-87c5afe191af service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:48.047109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:48.047109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:48.047109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:48.047893 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] PATH_INFO: `/v3/projects/bbe347ba7ade440aa5fba099e47b50da` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:48.047893 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe347ba7ade440aa5fba099e47b50da)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:48.048472 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:48.062691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:48.191036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe347ba7ade440aa5fba099e47b50da', 'request_id': 'req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.271291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd49c79-28b5-419c-8cfd-6ceda37c683b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:48.271476 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe347ba7ade440aa5fba099e47b50da', 'request_id': 'req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.272894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fbd49c79-28b5-419c-8cfd-6ceda37c683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:48.278836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe347ba7ade440aa5fba099e47b50da', 'request_id': 'req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.285148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd49c79-28b5-419c-8cfd-6ceda37c683b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:48.290422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] The token cache is being invalidate because project bbe347ba7ade440aa5fba099e47b50da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:45:48.290807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.291471 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.293139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1238/2502] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:45:48 2022] DELETE /identity/v3/projects/bbe347ba7ade440aa5fba099e47b50da => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:48.296930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:48.298257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:48.338170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:48.338782 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:48.339059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:48.339326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:48.341149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:48.353297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:48.354863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:48.363001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1265/2503] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:45:48.365956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5b00d-f954-4662-bdeb-a79a8e97f2ec admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:48.371902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:48.372554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:48.372839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:48.373120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] PATH_INFO: `/v3/users/f1e6d77864ca40b7ba41c0accd0a7851` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:48.374285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e6d77864ca40b7ba41c0accd0a7851)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:48.376504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:48.563776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e6d77864ca40b7ba41c0accd0a7851'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.574070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e6d77864ca40b7ba41c0accd0a7851'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.587273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e6d77864ca40b7ba41c0accd0a7851'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.659923 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e6d77864ca40b7ba41c0accd0a7851'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.660755 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fe1fc788-fd98-477f-a0d5-e2aaa591c803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e6d77864ca40b7ba41c0accd0a7851'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:48.667809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1239/2504] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:45:48 2022] DELETE /identity/v3/users/f1e6d77864ca40b7ba41c0accd0a7851 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:45:49.081677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.101243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9391-f822-49ca-b285-a731319cbf5c service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.145524 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:49.183835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.184471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.184784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.185082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] PATH_INFO: `/v3/projects/6510a0a48f3942598e639fea062fae80` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.186279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6510a0a48f3942598e639fea062fae80)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:49.188197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:49.291065 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6510a0a48f3942598e639fea062fae80', 'request_id': 'req-5956a4d1-339b-4e4d-b427-8745ebb7aa27'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:49.297754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6510a0a48f3942598e639fea062fae80', 'request_id': 'req-5956a4d1-339b-4e4d-b427-8745ebb7aa27'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:49.305959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6510a0a48f3942598e639fea062fae80', 'request_id': 'req-5956a4d1-339b-4e4d-b427-8745ebb7aa27'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:49.374451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] The token cache is being invalidate because project 6510a0a48f3942598e639fea062fae80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:45:49.374746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:49.375381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5956a4d1-339b-4e4d-b427-8745ebb7aa27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:49.377314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1266/2505] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:45:49 2022] DELETE /identity/v3/projects/6510a0a48f3942598e639fea062fae80 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:49.384136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773eed-e29a-498d-8353-285f0bb38484 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.384643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773eed-e29a-498d-8353-285f0bb38484 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.384809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773eed-e29a-498d-8353-285f0bb38484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.406097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-23773eed-e29a-498d-8353-285f0bb38484 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:49.407389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-23773eed-e29a-498d-8353-285f0bb38484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:49.418232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:49.467318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1240/2506] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:49.475523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5889-d4df-4159-a62d-243bba9739ae None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.476014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5889-d4df-4159-a62d-243bba9739ae None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.476362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b5889-d4df-4159-a62d-243bba9739ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.496205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-da2b5889-d4df-4159-a62d-243bba9739ae None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:49.497495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-da2b5889-d4df-4159-a62d-243bba9739ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:49.505544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1267/2507] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:49.510576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23773eed-e29a-498d-8353-285f0bb38484 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.520389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23773eed-e29a-498d-8353-285f0bb38484 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.525747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.526347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.526629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.526926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.527568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:45:49.527873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:49.529508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:49.541798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1241/2508] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:45:49.546121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b5889-d4df-4159-a62d-243bba9739ae None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.556300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b5889-d4df-4159-a62d-243bba9739ae None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.561046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.561661 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.561940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.567787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.567787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:49.567787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:49.650736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1268/2509] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:45:49 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:49.654931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.665585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee9bde-4e2b-4c9b-8da2-ece2e3db0c5d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.721790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.722404 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.722685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.722960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.723648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:49.725708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:49.792269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.794085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:49.827306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1242/2510] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:45:49 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:49.828147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.829986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:49.870123 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f7e8-38ed-4b80-b9b9-ef176e80af4e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.875714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.876728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.877011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.877292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.879060 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:49.887713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99227c35-98a2-4866-8229-4da749850577 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.891498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dacf0-37f0-472e-acc3-315ee2c49902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.891711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:49.892112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dacf0-37f0-472e-acc3-315ee2c49902 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.892530 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dacf0-37f0-472e-acc3-315ee2c49902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.892925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dacf0-37f0-472e-acc3-315ee2c49902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.893543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:49.896349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-648dacf0-37f0-472e-acc3-315ee2c49902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:49.905010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1269/2511] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:49.905457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.916239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0f4bd-a3e3-428b-b094-77c4f0637c4e service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.922139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd543c7-2417-49df-8a13-e1b644639af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.922743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd543c7-2417-49df-8a13-e1b644639af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.924001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd543c7-2417-49df-8a13-e1b644639af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.924001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd543c7-2417-49df-8a13-e1b644639af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.924001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd543c7-2417-49df-8a13-e1b644639af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:49.926012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd543c7-2417-49df-8a13-e1b644639af1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:49.938898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1270/2512] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:49.942813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd543c7-2417-49df-8a13-e1b644639af1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.953585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd543c7-2417-49df-8a13-e1b644639af1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.958444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9742e9-b19e-4d7c-9d0e-95930a9d5c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.959059 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9742e9-b19e-4d7c-9d0e-95930a9d5c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.959323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9742e9-b19e-4d7c-9d0e-95930a9d5c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.959600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9742e9-b19e-4d7c-9d0e-95930a9d5c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:49.960909 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9742e9-b19e-4d7c-9d0e-95930a9d5c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:49.962617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9742e9-b19e-4d7c-9d0e-95930a9d5c21 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:49.964245 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:49.977482 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1271/2513] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:45:49.977682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dacf0-37f0-472e-acc3-315ee2c49902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:49.977682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dacf0-37f0-472e-acc3-315ee2c49902 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:49.979351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9742e9-b19e-4d7c-9d0e-95930a9d5c21 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:49.991223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9742e9-b19e-4d7c-9d0e-95930a9d5c21 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:49.993485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1243/2514] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:49.996854 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:49.997637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:49.998025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:49.998333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] PATH_INFO: `/v3/projects/c62ccc6bece3452ebd107455844e7d10/users/444a812051884eea83f92bb39ede3278/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:50.015204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62ccc6bece3452ebd107455844e7d10, user_id=444a812051884eea83f92bb39ede3278, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:50.018166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:50.032016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:50.083767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1272/2515] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:45:49 2022] PUT /identity/v3/projects/c62ccc6bece3452ebd107455844e7d10/users/444a812051884eea83f92bb39ede3278/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:50.096744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d384-447c-4c39-896c-102d94650ee0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:50.097037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d384-447c-4c39-896c-102d94650ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:50.097418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d384-447c-4c39-896c-102d94650ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:50.127323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2e37d384-447c-4c39-896c-102d94650ee0 None None] MFA Rules not processed for user `444a812051884eea83f92bb39ede3278`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:50.128568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2e37d384-447c-4c39-896c-102d94650ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:50.198183 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1244/2516] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:50.212738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:50.214294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:50.272768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828adbd-e70f-475e-98a5-b1a1dbb65ddf admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:50.276374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6cb52-50e0-464e-a1f7-182c9f9c68af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa1d30decad84c7081c7e150812b2964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:50.277000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6cb52-50e0-464e-a1f7-182c9f9c68af service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:50.277280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6cb52-50e0-464e-a1f7-182c9f9c68af service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:50.277552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6cb52-50e0-464e-a1f7-182c9f9c68af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:50.286072 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6cb52-50e0-464e-a1f7-182c9f9c68af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:50.290249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6cb52-50e0-464e-a1f7-182c9f9c68af service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:50.296622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1273/2517] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:50.722087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37d384-447c-4c39-896c-102d94650ee0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:50.723565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2e37d384-447c-4c39-896c-102d94650ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:50.783871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37d384-447c-4c39-896c-102d94650ee0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:50.787477 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:50.788732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:50.789016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:50.793899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:50.793899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:50.857526 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:50.858973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:50.868830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1245/2518] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:52.139480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6cb52-50e0-464e-a1f7-182c9f9c68af service glance] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:52.151243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6cb52-50e0-464e-a1f7-182c9f9c68af service glance] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:52.154817 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:52.155542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:52.155938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:52.156220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:52.158119 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:52.176024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:52.177589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:52.190005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1274/2519] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:55.357673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:55.359908 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:55.375023 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822561c-81ca-45ac-ad3f-35182206358f service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:55.380757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:55.381825 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:55.382383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:55.383058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] PATH_INFO: `/v3/users/808156c7457b4e8b9b6c5f305755b3f3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:55.385126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=808156c7457b4e8b9b6c5f305755b3f3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:55.391470 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:55.395185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:55.617817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808156c7457b4e8b9b6c5f305755b3f3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:55.637604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808156c7457b4e8b9b6c5f305755b3f3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:55.677852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808156c7457b4e8b9b6c5f305755b3f3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:55.739867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808156c7457b4e8b9b6c5f305755b3f3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:55.740836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3c1f0aa1-0fd2-46e7-952d-6e360d40a471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808156c7457b4e8b9b6c5f305755b3f3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:55.758964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1246/2520] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:45:55 2022] DELETE /identity/v3/users/808156c7457b4e8b9b6c5f305755b3f3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:56.125716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:56.137279 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec385-358e-4457-ab1c-9e66418c2f1c service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:56.221635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:56.222405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:56.222750 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:56.223186 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] PATH_INFO: `/v3/projects/e4de2627ff884f9f9afd68edb0dadf26` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:56.224766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4de2627ff884f9f9afd68edb0dadf26)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:56.226963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:56.339769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4de2627ff884f9f9afd68edb0dadf26', 'request_id': 'req-f68787f2-d05e-4561-9629-00ad818c5fe4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:56.345990 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4de2627ff884f9f9afd68edb0dadf26', 'request_id': 'req-f68787f2-d05e-4561-9629-00ad818c5fe4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:56.353415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4de2627ff884f9f9afd68edb0dadf26', 'request_id': 'req-f68787f2-d05e-4561-9629-00ad818c5fe4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:56.354768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:56.431111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] The token cache is being invalidate because project e4de2627ff884f9f9afd68edb0dadf26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:45:56.431520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:56.433243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f68787f2-d05e-4561-9629-00ad818c5fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:56.435502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1275/2521] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:45:56 2022] DELETE /identity/v3/projects/e4de2627ff884f9f9afd68edb0dadf26 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:56.443373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961ff8-5528-426c-8c15-a367da9a98dd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:56.443945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961ff8-5528-426c-8c15-a367da9a98dd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:56.444058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961ff8-5528-426c-8c15-a367da9a98dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:56.487832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e5961ff8-5528-426c-8c15-a367da9a98dd None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:56.490136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e5961ff8-5528-426c-8c15-a367da9a98dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:56.605674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1247/2522] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:56.613588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d6fd-bef9-4f8b-9149-c90b9afab6fc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:56.613962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d6fd-bef9-4f8b-9149-c90b9afab6fc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:56.614314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d6fd-bef9-4f8b-9149-c90b9afab6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:56.639295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2db2d6fd-bef9-4f8b-9149-c90b9afab6fc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:56.640669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2db2d6fd-bef9-4f8b-9149-c90b9afab6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:56.660139 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1276/2523] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:56.662781 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5961ff8-5528-426c-8c15-a367da9a98dd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:56.681231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5961ff8-5528-426c-8c15-a367da9a98dd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:56.688431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:56.689894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:56.689894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:56.690809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:56.691586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:45:56.691996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:56.693785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:56.709710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1248/2524] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:45:56.713706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d6fd-bef9-4f8b-9149-c90b9afab6fc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:56.728527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d6fd-bef9-4f8b-9149-c90b9afab6fc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:56.733459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2712bb-5da5-4b71-a1f8-bff7e31ec32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:56.738348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2712bb-5da5-4b71-a1f8-bff7e31ec32d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:56.738348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2712bb-5da5-4b71-a1f8-bff7e31ec32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:56.738348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2712bb-5da5-4b71-a1f8-bff7e31ec32d admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:56.738348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2712bb-5da5-4b71-a1f8-bff7e31ec32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:56.738348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2712bb-5da5-4b71-a1f8-bff7e31ec32d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:56.827605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1277/2525] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:45:56 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:56.833258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:56.845086 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a80ed8-2e30-4e4f-a447-008452181562 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:56.908115 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df5184-b62e-4181-943e-5049f0a54e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:56.908762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5184-b62e-4181-943e-5049f0a54e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:56.909047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5184-b62e-4181-943e-5049f0a54e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:56.909365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5184-b62e-4181-943e-5049f0a54e5a admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:56.910008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df5184-b62e-4181-943e-5049f0a54e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:56.912170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df5184-b62e-4181-943e-5049f0a54e5a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:57.051350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1249/2526] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:45:56 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:45:57.053740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2712bb-5da5-4b71-a1f8-bff7e31ec32d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:57.064555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2712bb-5da5-4b71-a1f8-bff7e31ec32d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:57.069308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10158b96-ab24-4aab-af1a-e7b9972f6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:57.070120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158b96-ab24-4aab-af1a-e7b9972f6852 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:57.070456 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158b96-ab24-4aab-af1a-e7b9972f6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:57.070931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158b96-ab24-4aab-af1a-e7b9972f6852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:57.071576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10158b96-ab24-4aab-af1a-e7b9972f6852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:57.073255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10158b96-ab24-4aab-af1a-e7b9972f6852 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:57.083168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1278/2527] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:57.088735 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df5184-b62e-4181-943e-5049f0a54e5a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:57.093961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:57.099400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df5184-b62e-4181-943e-5049f0a54e5a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:57.105326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314286b-5050-470a-ab4e-e224bd66fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:57.106055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314286b-5050-470a-ab4e-e224bd66fedd admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:57.106447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314286b-5050-470a-ab4e-e224bd66fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:57.106805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314286b-5050-470a-ab4e-e224bd66fedd admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:57.107552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314286b-5050-470a-ab4e-e224bd66fedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:57.109251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314286b-5050-470a-ab4e-e224bd66fedd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:57.121285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1250/2528] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:57.125544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10158b96-ab24-4aab-af1a-e7b9972f6852 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:57.142853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10158b96-ab24-4aab-af1a-e7b9972f6852 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:57.149108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d07fa3-5eca-4214-85ec-f1e3f5f1db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:57.149848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d07fa3-5eca-4214-85ec-f1e3f5f1db72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:57.150132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d07fa3-5eca-4214-85ec-f1e3f5f1db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:57.150411 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d07fa3-5eca-4214-85ec-f1e3f5f1db72 admin admin] PATH_INFO: `/v3/projects/8cdc1aaae02b48cd9876c47172094790/users/6021102abe6e44a0926068595764a489/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:57.171174 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d07fa3-5eca-4214-85ec-f1e3f5f1db72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdc1aaae02b48cd9876c47172094790, user_id=6021102abe6e44a0926068595764a489, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:57.174394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d07fa3-5eca-4214-85ec-f1e3f5f1db72 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:57.281743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1279/2529] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:45:57 2022] PUT /identity/v3/projects/8cdc1aaae02b48cd9876c47172094790/users/6021102abe6e44a0926068595764a489/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:57.295190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6237e-9aa7-4f81-a001-978825475586 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:57.295573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6237e-9aa7-4f81-a001-978825475586 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:57.295921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6237e-9aa7-4f81-a001-978825475586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:57.338358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2fb6237e-9aa7-4f81-a001-978825475586 None None] MFA Rules not processed for user `6021102abe6e44a0926068595764a489`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:57.339959 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2fb6237e-9aa7-4f81-a001-978825475586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:57.451245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1251/2530] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:57.455631 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d07fa3-5eca-4214-85ec-f1e3f5f1db72 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:57.532776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d07fa3-5eca-4214-85ec-f1e3f5f1db72 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:57.537772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c07e-ce62-4af8-9d8d-c10efa4fd6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:57.538706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c07e-ce62-4af8-9d8d-c10efa4fd6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:57.539239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c07e-ce62-4af8-9d8d-c10efa4fd6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:57.539516 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c07e-ce62-4af8-9d8d-c10efa4fd6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:57.540153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c07e-ce62-4af8-9d8d-c10efa4fd6a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:57.542095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c07e-ce62-4af8-9d8d-c10efa4fd6a0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:57.677027 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1280/2531] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:45:57 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:57.678337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6237e-9aa7-4f81-a001-978825475586 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:57.690717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6237e-9aa7-4f81-a001-978825475586 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:57.814933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47969e6-02f7-4e44-9823-a9263fb3bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:57.815786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47969e6-02f7-4e44-9823-a9263fb3bfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:57.816290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47969e6-02f7-4e44-9823-a9263fb3bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:57.816736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47969e6-02f7-4e44-9823-a9263fb3bfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:57.817620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47969e6-02f7-4e44-9823-a9263fb3bfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:57.820532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47969e6-02f7-4e44-9823-a9263fb3bfe1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:57.912063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1252/2532] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:45:57 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:45:57.916651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c07e-ce62-4af8-9d8d-c10efa4fd6a0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:57.927961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c07e-ce62-4af8-9d8d-c10efa4fd6a0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:57.935322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:57.935968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:57.936250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:57.936613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:57.939505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:57.939505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:57.951938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1281/2533] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:57.956153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47969e6-02f7-4e44-9823-a9263fb3bfe1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:57.971149 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47969e6-02f7-4e44-9823-a9263fb3bfe1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:57.975998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d075d8-9ae4-457d-adef-f6602af332b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:57.976756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d075d8-9ae4-457d-adef-f6602af332b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:57.977040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d075d8-9ae4-457d-adef-f6602af332b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:57.977303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d075d8-9ae4-457d-adef-f6602af332b6 admin admin] PATH_INFO: `/v3/projects/54d806d1ec284a0eb4527c5f463b10f4/users/16b29cb61f0e4d4799e7eaa4ab0233fa/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:57.992751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d075d8-9ae4-457d-adef-f6602af332b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d806d1ec284a0eb4527c5f463b10f4, user_id=16b29cb61f0e4d4799e7eaa4ab0233fa, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:57.995322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d075d8-9ae4-457d-adef-f6602af332b6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:58.037257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:58.039130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:58.050609 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1253/2534] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:45:57 2022] PUT /identity/v3/projects/54d806d1ec284a0eb4527c5f463b10f4/users/16b29cb61f0e4d4799e7eaa4ab0233fa/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:58.054506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d075d8-9ae4-457d-adef-f6602af332b6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:58.060926 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac75d21-110d-45c2-823a-eea89a24cb6c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:58.103186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:58.116937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d075d8-9ae4-457d-adef-f6602af332b6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:58.120584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:58.121986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:58.121986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:58.122271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291b034-db11-48b3-8b79-f1afe6cf4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:58.122393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] PATH_INFO: `/v3/users/833edf46ef9b4d3982ce49abc74933a2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:58.122506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291b034-db11-48b3-8b79-f1afe6cf4604 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:58.122506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291b034-db11-48b3-8b79-f1afe6cf4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:58.122744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291b034-db11-48b3-8b79-f1afe6cf4604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:58.123375 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291b034-db11-48b3-8b79-f1afe6cf4604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:58.123505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833edf46ef9b4d3982ce49abc74933a2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:58.124998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291b034-db11-48b3-8b79-f1afe6cf4604 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:58.125371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:58.128289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:58.135993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1254/2535] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:45:58.140085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291b034-db11-48b3-8b79-f1afe6cf4604 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:58.150781 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291b034-db11-48b3-8b79-f1afe6cf4604 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:58.155567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1332f2-18e8-4cba-91e2-ffa44cebdb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:58.156213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1332f2-18e8-4cba-91e2-ffa44cebdb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:58.156521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1332f2-18e8-4cba-91e2-ffa44cebdb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:58.156835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1332f2-18e8-4cba-91e2-ffa44cebdb9e admin admin] PATH_INFO: `/v3/projects/54d806d1ec284a0eb4527c5f463b10f4/users/16b29cb61f0e4d4799e7eaa4ab0233fa/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:58.159216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1332f2-18e8-4cba-91e2-ffa44cebdb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d806d1ec284a0eb4527c5f463b10f4, user_id=16b29cb61f0e4d4799e7eaa4ab0233fa, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:58.161976 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1332f2-18e8-4cba-91e2-ffa44cebdb9e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:58.179489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1255/2536] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:45:58 2022] PUT /identity/v3/projects/54d806d1ec284a0eb4527c5f463b10f4/users/16b29cb61f0e4d4799e7eaa4ab0233fa/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:45:58.193511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1bb7b-58b0-429e-a4f6-e6bec67efde8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:58.193798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1bb7b-58b0-429e-a4f6-e6bec67efde8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:58.194074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1bb7b-58b0-429e-a4f6-e6bec67efde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:58.222539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7fc1bb7b-58b0-429e-a4f6-e6bec67efde8 None None] MFA Rules not processed for user `16b29cb61f0e4d4799e7eaa4ab0233fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:58.223869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7fc1bb7b-58b0-429e-a4f6-e6bec67efde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:58.293390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1256/2537] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:45:58.305467 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1bb7b-58b0-429e-a4f6-e6bec67efde8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:58.306952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7fc1bb7b-58b0-429e-a4f6-e6bec67efde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:58.311707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833edf46ef9b4d3982ce49abc74933a2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.325292 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833edf46ef9b4d3982ce49abc74933a2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.332189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833edf46ef9b4d3982ce49abc74933a2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.363606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1bb7b-58b0-429e-a4f6-e6bec67efde8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:58.367501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175579-58ef-434a-bd27-b10f60683dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:58.368101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175579-58ef-434a-bd27-b10f60683dbb service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:58.368378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175579-58ef-434a-bd27-b10f60683dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:58.368684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175579-58ef-434a-bd27-b10f60683dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:58.377899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175579-58ef-434a-bd27-b10f60683dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:58.379359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175579-58ef-434a-bd27-b10f60683dbb service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:58.388930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1257/2538] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:45:58.408629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833edf46ef9b4d3982ce49abc74933a2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.409284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833edf46ef9b4d3982ce49abc74933a2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.416559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1282/2539] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:45:58 2022] DELETE /identity/v3/users/833edf46ef9b4d3982ce49abc74933a2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:45:58.599432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175579-58ef-434a-bd27-b10f60683dbb service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:58.608296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175579-58ef-434a-bd27-b10f60683dbb service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:58.658073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70862a-3805-4c63-aa2f-93ddac52291d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:58.658808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70862a-3805-4c63-aa2f-93ddac52291d service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:58.658955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70862a-3805-4c63-aa2f-93ddac52291d service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:58.659237 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70862a-3805-4c63-aa2f-93ddac52291d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:58.661230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2f70862a-3805-4c63-aa2f-93ddac52291d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:58.662365 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:58.664604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:58.674712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:58.730744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70862a-3805-4c63-aa2f-93ddac52291d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:58.732190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70862a-3805-4c63-aa2f-93ddac52291d service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:58.735702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7837-0003-4f60-81a4-649b1a79c208 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:58.740590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:58.741911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:58.742255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:58.742447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1258/2540] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:45:58.742692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] PATH_INFO: `/v3/projects/c727384d4ff043809f8421840cbd7596` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:58.743924 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c727384d4ff043809f8421840cbd7596)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:58.745881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:58.844038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c727384d4ff043809f8421840cbd7596', 'request_id': 'req-8d80fad3-1299-468e-a4c8-2c04e4b94652'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.849624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c727384d4ff043809f8421840cbd7596', 'request_id': 'req-8d80fad3-1299-468e-a4c8-2c04e4b94652'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.856757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c727384d4ff043809f8421840cbd7596', 'request_id': 'req-8d80fad3-1299-468e-a4c8-2c04e4b94652'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.928223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] The token cache is being invalidate because project c727384d4ff043809f8421840cbd7596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:45:58.928555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.929346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8d80fad3-1299-468e-a4c8-2c04e4b94652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:45:58.930978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1283/2541] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:45:58 2022] DELETE /identity/v3/projects/c727384d4ff043809f8421840cbd7596 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:45:58.937314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14368c-e471-456e-acd5-c51c873d1ffe None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:58.937658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14368c-e471-456e-acd5-c51c873d1ffe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:58.937943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14368c-e471-456e-acd5-c51c873d1ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:58.959782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cc14368c-e471-456e-acd5-c51c873d1ffe None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:58.964591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cc14368c-e471-456e-acd5-c51c873d1ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:59.024837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1259/2542] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:59.032308 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c275b2-ec7a-443d-8ff5-458a7f9d5e13 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.032625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c275b2-ec7a-443d-8ff5-458a7f9d5e13 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.032906 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c275b2-ec7a-443d-8ff5-458a7f9d5e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.053146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-04c275b2-ec7a-443d-8ff5-458a7f9d5e13 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:59.054990 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04c275b2-ec7a-443d-8ff5-458a7f9d5e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:59.063399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1284/2543] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:59.067738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14368c-e471-456e-acd5-c51c873d1ffe None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:59.078620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14368c-e471-456e-acd5-c51c873d1ffe None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:59.083209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:59.083809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.084092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.084373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.085171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:45:59.085591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:59.087170 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:59.098773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1260/2544] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:45:59.103383 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c275b2-ec7a-443d-8ff5-458a7f9d5e13 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:59.114066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:59.117605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c275b2-ec7a-443d-8ff5-458a7f9d5e13 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:59.122730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283feb1b-b88e-4a6f-95a0-3d4d719986c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:59.123359 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283feb1b-b88e-4a6f-95a0-3d4d719986c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.123642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283feb1b-b88e-4a6f-95a0-3d4d719986c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.123916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283feb1b-b88e-4a6f-95a0-3d4d719986c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.124591 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283feb1b-b88e-4a6f-95a0-3d4d719986c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:59.126887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283feb1b-b88e-4a6f-95a0-3d4d719986c8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:59.244975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1285/2545] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:45:59 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:59.249166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:59.261458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541c00d-580b-47ea-a86c-b45249bd9bf2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:59.317137 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba26b3-b340-4dd0-8696-13cbee48cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:59.317739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba26b3-b340-4dd0-8696-13cbee48cb39 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.318017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba26b3-b340-4dd0-8696-13cbee48cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.318289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba26b3-b340-4dd0-8696-13cbee48cb39 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.318906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba26b3-b340-4dd0-8696-13cbee48cb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:59.321570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba26b3-b340-4dd0-8696-13cbee48cb39 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:59.395958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1261/2546] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:45:59 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:45:59.400330 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283feb1b-b88e-4a6f-95a0-3d4d719986c8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:59.410785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283feb1b-b88e-4a6f-95a0-3d4d719986c8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:59.415950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31a6ab-23af-4f66-a818-1cd3aaf85686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:59.416580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a6ab-23af-4f66-a818-1cd3aaf85686 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.416865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a6ab-23af-4f66-a818-1cd3aaf85686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.417142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31a6ab-23af-4f66-a818-1cd3aaf85686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.417787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31a6ab-23af-4f66-a818-1cd3aaf85686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:59.419385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31a6ab-23af-4f66-a818-1cd3aaf85686 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:59.429891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1286/2547] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:59.433773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba26b3-b340-4dd0-8696-13cbee48cb39 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:59.443488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba26b3-b340-4dd0-8696-13cbee48cb39 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:59.448073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532335-df00-41a9-8fae-2ce5e94afcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:59.448688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532335-df00-41a9-8fae-2ce5e94afcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.448965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532335-df00-41a9-8fae-2ce5e94afcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.449236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532335-df00-41a9-8fae-2ce5e94afcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.449862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21532335-df00-41a9-8fae-2ce5e94afcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:59.451425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21532335-df00-41a9-8fae-2ce5e94afcf6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:59.461670 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1262/2548] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:45:59.465790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31a6ab-23af-4f66-a818-1cd3aaf85686 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:59.482978 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31a6ab-23af-4f66-a818-1cd3aaf85686 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:59.487530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:59.490781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.490781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.490781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] PATH_INFO: `/v3/projects/a8177f48f6c44e5f8072cefd26bbb1f4/users/c58dab81b6ed40b89a401463549add49/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.503975 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8177f48f6c44e5f8072cefd26bbb1f4, user_id=c58dab81b6ed40b89a401463549add49, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:59.506652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:59.573866 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1287/2549] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:45:59 2022] PUT /identity/v3/projects/a8177f48f6c44e5f8072cefd26bbb1f4/users/c58dab81b6ed40b89a401463549add49/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:45:59.585428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7bad2-935d-4120-a5c6-6f121be0b511 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.585709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7bad2-935d-4120-a5c6-6f121be0b511 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.585985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7bad2-935d-4120-a5c6-6f121be0b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.618468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-31e7bad2-935d-4120-a5c6-6f121be0b511 None None] MFA Rules not processed for user `c58dab81b6ed40b89a401463549add49`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:45:59.619214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-31e7bad2-935d-4120-a5c6-6f121be0b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:59.624364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:59.682935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1263/2550] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:45:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:45:59.695753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:45:59.697518 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:45:59.773667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a08855-fcf1-4af1-8359-5fcb29701245 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:45:59.779351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af20971-9548-4ae5-937d-a6928bca33a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:45:59.779965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20971-9548-4ae5-937d-a6928bca33a4 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:45:59.780254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20971-9548-4ae5-937d-a6928bca33a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:45:59.780571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20971-9548-4ae5-937d-a6928bca33a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:45:59.789159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af20971-9548-4ae5-937d-a6928bca33a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:45:59.790766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af20971-9548-4ae5-937d-a6928bca33a4 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:45:59.799530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1288/2551] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:07.382323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7bad2-935d-4120-a5c6-6f121be0b511 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:07.457494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7bad2-935d-4120-a5c6-6f121be0b511 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:07.461949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:07.462586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:07.463412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:07.463691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] PATH_INFO: `/v3/users/c58dab81b6ed40b89a401463549add49` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:07.464912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58dab81b6ed40b89a401463549add49)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:07.466827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:07.673006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58dab81b6ed40b89a401463549add49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:07.679897 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58dab81b6ed40b89a401463549add49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:07.691921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58dab81b6ed40b89a401463549add49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:07.780125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58dab81b6ed40b89a401463549add49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:07.780787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58dab81b6ed40b89a401463549add49'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:07.787283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1264/2552] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:07 2022] DELETE /identity/v3/users/c58dab81b6ed40b89a401463549add49 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:07.792170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b9b3-1b3a-4da0-9d5d-48e1b5297838 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:07.792654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b9b3-1b3a-4da0-9d5d-48e1b5297838 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:07.792759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b9b3-1b3a-4da0-9d5d-48e1b5297838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:07.811617 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f4d0b9b3-1b3a-4da0-9d5d-48e1b5297838 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:07.812872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f4d0b9b3-1b3a-4da0-9d5d-48e1b5297838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:07.876035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1289/2553] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:46:07.886728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:07.888159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:07.922152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:07.961057 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf69a-9e44-4e1e-8326-41a1e5e42113 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:07.965663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aa258-de34-431f-a431-2ffc58ff288b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:07.965998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa258-de34-431f-a431-2ffc58ff288b service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:07.966276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa258-de34-431f-a431-2ffc58ff288b service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:07.966547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa258-de34-431f-a431-2ffc58ff288b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:07.975366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aa258-de34-431f-a431-2ffc58ff288b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:07.976816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aa258-de34-431f-a431-2ffc58ff288b service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:07.986344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1265/2554] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:46:08.410069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0b9b3-1b3a-4da0-9d5d-48e1b5297838 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:08.412530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f4d0b9b3-1b3a-4da0-9d5d-48e1b5297838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:08.426043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0b9b3-1b3a-4da0-9d5d-48e1b5297838 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:08.432368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:08.433192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:08.433520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:08.433648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] PATH_INFO: `/v3/projects/a8177f48f6c44e5f8072cefd26bbb1f4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:08.434977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8177f48f6c44e5f8072cefd26bbb1f4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:08.437040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:08.543199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:08.560287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8177f48f6c44e5f8072cefd26bbb1f4', 'request_id': 'req-35183480-84e5-46f4-b03a-b59b05545e68'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:08.567038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8177f48f6c44e5f8072cefd26bbb1f4', 'request_id': 'req-35183480-84e5-46f4-b03a-b59b05545e68'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:08.576735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8177f48f6c44e5f8072cefd26bbb1f4', 'request_id': 'req-35183480-84e5-46f4-b03a-b59b05545e68'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:08.689122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] The token cache is being invalidate because project a8177f48f6c44e5f8072cefd26bbb1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:46:08.689420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:08.690051 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-35183480-84e5-46f4-b03a-b59b05545e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:08.691534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1290/2555] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:46:08 2022] DELETE /identity/v3/projects/a8177f48f6c44e5f8072cefd26bbb1f4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:08.696372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470066f2-bedf-4936-b672-66a9fd75498b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:08.699055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470066f2-bedf-4936-b672-66a9fd75498b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:08.699055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470066f2-bedf-4936-b672-66a9fd75498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:08.716680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-470066f2-bedf-4936-b672-66a9fd75498b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:08.717853 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-470066f2-bedf-4936-b672-66a9fd75498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:08.777804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1266/2556] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:08.785408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1ed97-0fda-4ce3-a7bf-6c63cf93f077 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:08.785698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1ed97-0fda-4ce3-a7bf-6c63cf93f077 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:08.785977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1ed97-0fda-4ce3-a7bf-6c63cf93f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:08.807688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0fb1ed97-0fda-4ce3-a7bf-6c63cf93f077 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:08.808933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0fb1ed97-0fda-4ce3-a7bf-6c63cf93f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:08.816916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1291/2557] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:08.821069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470066f2-bedf-4936-b672-66a9fd75498b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:08.831388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470066f2-bedf-4936-b672-66a9fd75498b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:08.835990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:08.836637 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:08.836922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:08.837198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:08.837847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:46:08.838887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:08.840501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:08.851999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1267/2558] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:46:08.857053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1ed97-0fda-4ce3-a7bf-6c63cf93f077 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:08.866232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1ed97-0fda-4ce3-a7bf-6c63cf93f077 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:08.871054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c12d6-9ca2-4d2b-8f37-13182c6bb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:08.871594 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c12d6-9ca2-4d2b-8f37-13182c6bb5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:08.871875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c12d6-9ca2-4d2b-8f37-13182c6bb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:08.872149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c12d6-9ca2-4d2b-8f37-13182c6bb5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:08.872822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c12d6-9ca2-4d2b-8f37-13182c6bb5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:08.874706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c12d6-9ca2-4d2b-8f37-13182c6bb5ec admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:08.947046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1292/2559] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:46:08 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:08.959265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:08.969836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60ec0-f8a4-4d31-9503-7ecf9f4faea8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.026095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7b103-2db0-43f4-ad62-45a127ea9333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.026750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7b103-2db0-43f4-ad62-45a127ea9333 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.027039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7b103-2db0-43f4-ad62-45a127ea9333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.027318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7b103-2db0-43f4-ad62-45a127ea9333 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.027972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7b103-2db0-43f4-ad62-45a127ea9333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:09.029913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7b103-2db0-43f4-ad62-45a127ea9333 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:09.106163 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1268/2560] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:46:08 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:09.110714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c12d6-9ca2-4d2b-8f37-13182c6bb5ec admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:09.121331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c12d6-9ca2-4d2b-8f37-13182c6bb5ec admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.125935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206973b9-bd52-4c4c-bfb4-c145b2874243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.126542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206973b9-bd52-4c4c-bfb4-c145b2874243 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.127092 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206973b9-bd52-4c4c-bfb4-c145b2874243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.127369 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206973b9-bd52-4c4c-bfb4-c145b2874243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.128013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206973b9-bd52-4c4c-bfb4-c145b2874243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:09.129657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206973b9-bd52-4c4c-bfb4-c145b2874243 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:09.140344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1293/2561] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:09.144171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7b103-2db0-43f4-ad62-45a127ea9333 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:09.155108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7b103-2db0-43f4-ad62-45a127ea9333 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.159702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106da45-d3cc-4a6f-a9bf-a5730cc439bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.160304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106da45-d3cc-4a6f-a9bf-a5730cc439bc admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.160621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106da45-d3cc-4a6f-a9bf-a5730cc439bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.160902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106da45-d3cc-4a6f-a9bf-a5730cc439bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.161581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106da45-d3cc-4a6f-a9bf-a5730cc439bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:09.163151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106da45-d3cc-4a6f-a9bf-a5730cc439bc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:09.175804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1269/2562] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:09.180289 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206973b9-bd52-4c4c-bfb4-c145b2874243 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:09.190928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206973b9-bd52-4c4c-bfb4-c145b2874243 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.195687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2cb61-38ee-4c31-98c6-b85d9b03a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.196322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2cb61-38ee-4c31-98c6-b85d9b03a9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.196640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2cb61-38ee-4c31-98c6-b85d9b03a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.197041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2cb61-38ee-4c31-98c6-b85d9b03a9a2 admin admin] PATH_INFO: `/v3/projects/f7f206c7b3fe46e693f548eea5ca64a8/users/8bb609433944433b9494e45890cb00ef/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.212669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2cb61-38ee-4c31-98c6-b85d9b03a9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f206c7b3fe46e693f548eea5ca64a8, user_id=8bb609433944433b9494e45890cb00ef, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:09.216305 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2cb61-38ee-4c31-98c6-b85d9b03a9a2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:09.277634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1294/2563] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:09 2022] PUT /identity/v3/projects/f7f206c7b3fe46e693f548eea5ca64a8/users/8bb609433944433b9494e45890cb00ef/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:09.289303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1452-ff0e-42c5-aee9-f5e528c62cb3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.289593 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1452-ff0e-42c5-aee9-f5e528c62cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.289869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1452-ff0e-42c5-aee9-f5e528c62cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.317127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2ffc1452-ff0e-42c5-aee9-f5e528c62cb3 None None] MFA Rules not processed for user `8bb609433944433b9494e45890cb00ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:09.318327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2ffc1452-ff0e-42c5-aee9-f5e528c62cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:09.330719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:09.383503 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1270/2564] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:09.388646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2cb61-38ee-4c31-98c6-b85d9b03a9a2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:09.451792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2cb61-38ee-4c31-98c6-b85d9b03a9a2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.456510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84221975-e4a2-45f3-aef1-5632e3e3058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.457210 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84221975-e4a2-45f3-aef1-5632e3e3058c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.458137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84221975-e4a2-45f3-aef1-5632e3e3058c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.458419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84221975-e4a2-45f3-aef1-5632e3e3058c admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.459050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84221975-e4a2-45f3-aef1-5632e3e3058c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:09.460981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84221975-e4a2-45f3-aef1-5632e3e3058c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:09.558969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1295/2565] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:46:09 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:09.563337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc1452-ff0e-42c5-aee9-f5e528c62cb3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:09.575101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc1452-ff0e-42c5-aee9-f5e528c62cb3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.631113 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0868a18-4fc7-42a3-8762-e6c5df5b2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.631647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868a18-4fc7-42a3-8762-e6c5df5b2d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.631935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868a18-4fc7-42a3-8762-e6c5df5b2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.632214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868a18-4fc7-42a3-8762-e6c5df5b2d6b admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.632875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0868a18-4fc7-42a3-8762-e6c5df5b2d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:09.634788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0868a18-4fc7-42a3-8762-e6c5df5b2d6b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:09.758628 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1271/2566] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:46:09 2022] POST /identity/v3/users => generated 307 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:09.760513 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84221975-e4a2-45f3-aef1-5632e3e3058c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:09.771696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84221975-e4a2-45f3-aef1-5632e3e3058c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.781611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a679c0e-95f7-468a-90a9-93ca8435ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.782057 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a679c0e-95f7-468a-90a9-93ca8435ecaa admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.782341 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a679c0e-95f7-468a-90a9-93ca8435ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.782618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a679c0e-95f7-468a-90a9-93ca8435ecaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.783269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a679c0e-95f7-468a-90a9-93ca8435ecaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:09.784956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a679c0e-95f7-468a-90a9-93ca8435ecaa admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:09.796111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1296/2567] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:46:09.800195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0868a18-4fc7-42a3-8762-e6c5df5b2d6b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:09.810819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0868a18-4fc7-42a3-8762-e6c5df5b2d6b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.815373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c4aea-373e-44e2-8450-3e7c1233a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.816018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c4aea-373e-44e2-8450-3e7c1233a2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.816308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c4aea-373e-44e2-8450-3e7c1233a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.816599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c4aea-373e-44e2-8450-3e7c1233a2dc admin admin] PATH_INFO: `/v3/projects/4d411f56a3c2497fb2b24c28ef428f5f/users/d69290ca8911487bb631482a23b6a4ee/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.832078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c4aea-373e-44e2-8450-3e7c1233a2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d411f56a3c2497fb2b24c28ef428f5f, user_id=d69290ca8911487bb631482a23b6a4ee, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:09.834731 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c4aea-373e-44e2-8450-3e7c1233a2dc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:09.923413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1272/2568] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:09 2022] PUT /identity/v3/projects/4d411f56a3c2497fb2b24c28ef428f5f/users/d69290ca8911487bb631482a23b6a4ee/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:09.927432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a679c0e-95f7-468a-90a9-93ca8435ecaa admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:09.938156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a679c0e-95f7-468a-90a9-93ca8435ecaa admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:09.961938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:09.996837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199996-bbd5-4a1b-ab4a-646b716366e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:09.997444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199996-bbd5-4a1b-ab4a-646b716366e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:09.997815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199996-bbd5-4a1b-ab4a-646b716366e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:09.998104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199996-bbd5-4a1b-ab4a-646b716366e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:09.998765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199996-bbd5-4a1b-ab4a-646b716366e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:10.000353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc199996-bbd5-4a1b-ab4a-646b716366e6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:10.010778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1297/2569] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:10.015076 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c4aea-373e-44e2-8450-3e7c1233a2dc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:10.025416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c4aea-373e-44e2-8450-3e7c1233a2dc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:10.030142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:10.030792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:10.031077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:10.031355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] PATH_INFO: `/v3/projects/4d411f56a3c2497fb2b24c28ef428f5f/users/d69290ca8911487bb631482a23b6a4ee/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:10.033314 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d411f56a3c2497fb2b24c28ef428f5f, user_id=d69290ca8911487bb631482a23b6a4ee, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:10.035923 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:10.047045 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1273/2570] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:10 2022] PUT /identity/v3/projects/4d411f56a3c2497fb2b24c28ef428f5f/users/d69290ca8911487bb631482a23b6a4ee/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:10.057949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0726c-e34e-4a07-85e0-a455ef07149f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:10.058237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0726c-e34e-4a07-85e0-a455ef07149f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:10.060801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0726c-e34e-4a07-85e0-a455ef07149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:10.086284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8bc0726c-e34e-4a07-85e0-a455ef07149f None None] MFA Rules not processed for user `d69290ca8911487bb631482a23b6a4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:10.087504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8bc0726c-e34e-4a07-85e0-a455ef07149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:10.154933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1298/2571] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:10.165449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:10.167694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:10.224903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a637e-7206-41fc-a0e0-d525a7b798ba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:10.228425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597905-c3ad-4f09-a020-56d9f9758896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:10.229041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597905-c3ad-4f09-a020-56d9f9758896 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:10.229315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597905-c3ad-4f09-a020-56d9f9758896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:10.229584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597905-c3ad-4f09-a020-56d9f9758896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:10.238417 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597905-c3ad-4f09-a020-56d9f9758896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:10.239845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597905-c3ad-4f09-a020-56d9f9758896 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:10.255313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1274/2572] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:10 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:11.969325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0726c-e34e-4a07-85e0-a455ef07149f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:12.048299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0726c-e34e-4a07-85e0-a455ef07149f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:12.052878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:12.053523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:12.053804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:12.054076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] PATH_INFO: `/v3/users/8bb609433944433b9494e45890cb00ef` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:12.055276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb609433944433b9494e45890cb00ef)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:12.057810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:12.265229 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb609433944433b9494e45890cb00ef'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:12.267219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:12.285225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb609433944433b9494e45890cb00ef'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:12.293452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb609433944433b9494e45890cb00ef'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:12.357400 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb609433944433b9494e45890cb00ef'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:12.358054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb609433944433b9494e45890cb00ef'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:12.365009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1299/2573] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:11 2022] DELETE /identity/v3/users/8bb609433944433b9494e45890cb00ef => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:12.370298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9c2b-c5a3-45e5-bf41-77a9de20085c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:12.370798 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9c2b-c5a3-45e5-bf41-77a9de20085c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:12.370914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9c2b-c5a3-45e5-bf41-77a9de20085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:12.391831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e1ce9c2b-c5a3-45e5-bf41-77a9de20085c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:12.393080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e1ce9c2b-c5a3-45e5-bf41-77a9de20085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:12.397083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:12.458662 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1275/2574] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:12.469961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:12.471520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:12.537091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3d39-b193-4c6b-bc5a-04fcc855f00e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:12.540726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcc30b-c458-40a3-bc59-dfc9c400258d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:12.542162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc30b-c458-40a3-bc59-dfc9c400258d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:12.542474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc30b-c458-40a3-bc59-dfc9c400258d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:12.542753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc30b-c458-40a3-bc59-dfc9c400258d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:12.551938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcc30b-c458-40a3-bc59-dfc9c400258d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:12.553409 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcc30b-c458-40a3-bc59-dfc9c400258d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:12.563220 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1300/2575] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:12.988521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce9c2b-c5a3-45e5-bf41-77a9de20085c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:12.990300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e1ce9c2b-c5a3-45e5-bf41-77a9de20085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:13.004329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce9c2b-c5a3-45e5-bf41-77a9de20085c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:13.009969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:13.010743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:13.011135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:13.011440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] PATH_INFO: `/v3/projects/f7f206c7b3fe46e693f548eea5ca64a8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:13.020835 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f206c7b3fe46e693f548eea5ca64a8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:13.022851 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:13.124913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f206c7b3fe46e693f548eea5ca64a8', 'request_id': 'req-2d04526d-919e-4ec6-a840-88dac428bdc1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.162762 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f206c7b3fe46e693f548eea5ca64a8', 'request_id': 'req-2d04526d-919e-4ec6-a840-88dac428bdc1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.170299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f206c7b3fe46e693f548eea5ca64a8', 'request_id': 'req-2d04526d-919e-4ec6-a840-88dac428bdc1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.181401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] The token cache is being invalidate because project f7f206c7b3fe46e693f548eea5ca64a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:46:13.181661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.182969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.184454 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1276/2576] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:46:12 2022] DELETE /identity/v3/projects/f7f206c7b3fe46e693f548eea5ca64a8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:13.188627 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcc30b-c458-40a3-bc59-dfc9c400258d service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:13.198193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcc30b-c458-40a3-bc59-dfc9c400258d service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:13.255108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:13.255738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:13.256014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:13.256281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] PATH_INFO: `/v3/users/d69290ca8911487bb631482a23b6a4ee` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:13.257431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69290ca8911487bb631482a23b6a4ee)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:13.259364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:13.429219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69290ca8911487bb631482a23b6a4ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.442248 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69290ca8911487bb631482a23b6a4ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.447537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:13.451120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69290ca8911487bb631482a23b6a4ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.540306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69290ca8911487bb631482a23b6a4ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.540966 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4af7eb2f-4d9c-4f82-a14c-d504377ea31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69290ca8911487bb631482a23b6a4ee'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:13.547928 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1301/2577] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:13 2022] DELETE /identity/v3/users/d69290ca8911487bb631482a23b6a4ee => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:13.965224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:13.967519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:13.985969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04526d-919e-4ec6-a840-88dac428bdc1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:14.045954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:14.046620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.046902 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.047187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] PATH_INFO: `/v3/projects/4d411f56a3c2497fb2b24c28ef428f5f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.048318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d411f56a3c2497fb2b24c28ef428f5f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:14.050304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:14.137830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:14.147517 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d411f56a3c2497fb2b24c28ef428f5f', 'request_id': 'req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:14.215031 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d411f56a3c2497fb2b24c28ef428f5f', 'request_id': 'req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:14.221480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d411f56a3c2497fb2b24c28ef428f5f', 'request_id': 'req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:14.233152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] The token cache is being invalidate because project 4d411f56a3c2497fb2b24c28ef428f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:46:14.233805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:14.234494 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-72fed9d3-a50c-4a60-9b49-840bcf2cea0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:14.236111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1277/2578] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:46:13 2022] DELETE /identity/v3/projects/4d411f56a3c2497fb2b24c28ef428f5f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:14.241196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f45075-62ff-4bfd-8622-4a6a2de73368 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.241676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f45075-62ff-4bfd-8622-4a6a2de73368 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.241790 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f45075-62ff-4bfd-8622-4a6a2de73368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.261815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a4f45075-62ff-4bfd-8622-4a6a2de73368 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:14.263058 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a4f45075-62ff-4bfd-8622-4a6a2de73368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:14.334679 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1302/2579] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:14.343161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069b2c-3014-4a2c-b558-afedce41cb5a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.343456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069b2c-3014-4a2c-b558-afedce41cb5a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.343740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f069b2c-3014-4a2c-b558-afedce41cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.366103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9f069b2c-3014-4a2c-b558-afedce41cb5a None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:14.367350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9f069b2c-3014-4a2c-b558-afedce41cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:14.376341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1278/2580] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:14.381081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f45075-62ff-4bfd-8622-4a6a2de73368 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:14.392219 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f45075-62ff-4bfd-8622-4a6a2de73368 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:14.396921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:14.397540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.397821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.398095 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.398752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:46:14.399056 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:14.400771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:14.413723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1303/2581] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:46:14.418898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f069b2c-3014-4a2c-b558-afedce41cb5a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:14.428278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f069b2c-3014-4a2c-b558-afedce41cb5a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:14.433255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9641a-1c16-4929-89e7-eafa2631ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:14.433862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9641a-1c16-4929-89e7-eafa2631ee6b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.434145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9641a-1c16-4929-89e7-eafa2631ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.434420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9641a-1c16-4929-89e7-eafa2631ee6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.435049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9641a-1c16-4929-89e7-eafa2631ee6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:14.436989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9641a-1c16-4929-89e7-eafa2631ee6b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:14.564518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1279/2582] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:46:14 2022] POST /identity/v3/projects => generated 355 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:14.568892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:14.579756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b74f8-a4cf-4e08-bcff-ba07026ad929 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:14.639894 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da957f-d036-4d65-8eac-8c1f39ba3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:14.640428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da957f-d036-4d65-8eac-8c1f39ba3b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.640742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da957f-d036-4d65-8eac-8c1f39ba3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.641019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da957f-d036-4d65-8eac-8c1f39ba3b6f admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.641654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da957f-d036-4d65-8eac-8c1f39ba3b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:14.643562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da957f-d036-4d65-8eac-8c1f39ba3b6f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:14.757734 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1304/2583] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:46:14 2022] POST /identity/v3/users => generated 278 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:14.758933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9641a-1c16-4929-89e7-eafa2631ee6b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:14.770061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9641a-1c16-4929-89e7-eafa2631ee6b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:14.774754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4b8c-7e2f-45f4-bc3d-0ef7d0c69548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:14.778868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b8c-7e2f-45f4-bc3d-0ef7d0c69548 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.778868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b8c-7e2f-45f4-bc3d-0ef7d0c69548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.778868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b8c-7e2f-45f4-bc3d-0ef7d0c69548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.778868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4b8c-7e2f-45f4-bc3d-0ef7d0c69548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:14.778868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4b8c-7e2f-45f4-bc3d-0ef7d0c69548 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:14.789447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1280/2584] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:14.793526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da957f-d036-4d65-8eac-8c1f39ba3b6f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:14.803810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da957f-d036-4d65-8eac-8c1f39ba3b6f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:14.809479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee5545-6cbd-4ced-85a7-b91c09db8fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:14.810080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee5545-6cbd-4ced-85a7-b91c09db8fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.810363 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee5545-6cbd-4ced-85a7-b91c09db8fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.810639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee5545-6cbd-4ced-85a7-b91c09db8fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.811286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee5545-6cbd-4ced-85a7-b91c09db8fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:14.813004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee5545-6cbd-4ced-85a7-b91c09db8fe6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:14.824412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1305/2585] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:14.828727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4b8c-7e2f-45f4-bc3d-0ef7d0c69548 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:14.841484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4b8c-7e2f-45f4-bc3d-0ef7d0c69548 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:14.847183 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71951b-e6cd-4983-9d50-7109ecdd5fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:14.847839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71951b-e6cd-4983-9d50-7109ecdd5fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.848245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71951b-e6cd-4983-9d50-7109ecdd5fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.848697 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71951b-e6cd-4983-9d50-7109ecdd5fff admin admin] PATH_INFO: `/v3/projects/8c12026f97334cb2ad7eefe1148e3621/users/c5f4ad7cb6ae4de0b656922fdc27bc4e/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.864823 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71951b-e6cd-4983-9d50-7109ecdd5fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c12026f97334cb2ad7eefe1148e3621, user_id=c5f4ad7cb6ae4de0b656922fdc27bc4e, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:14.867493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71951b-e6cd-4983-9d50-7109ecdd5fff admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:14.940291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1281/2586] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:14 2022] PUT /identity/v3/projects/8c12026f97334cb2ad7eefe1148e3621/users/c5f4ad7cb6ae4de0b656922fdc27bc4e/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:46:14.952135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd3a0-ee92-4298-a4ca-c475e7acde64 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:14.952422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd3a0-ee92-4298-a4ca-c475e7acde64 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:14.952733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd3a0-ee92-4298-a4ca-c475e7acde64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:14.981732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c46fd3a0-ee92-4298-a4ca-c475e7acde64 None None] MFA Rules not processed for user `c5f4ad7cb6ae4de0b656922fdc27bc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:14.982938 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c46fd3a0-ee92-4298-a4ca-c475e7acde64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:15.035642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:15.057574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1306/2587] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:15.062406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71951b-e6cd-4983-9d50-7109ecdd5fff admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:15.164580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71951b-e6cd-4983-9d50-7109ecdd5fff admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:15.171774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4469d-3a3b-4d91-b9c8-bb85750ff8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:15.172525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4469d-3a3b-4d91-b9c8-bb85750ff8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:15.172992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4469d-3a3b-4d91-b9c8-bb85750ff8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:15.173204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4469d-3a3b-4d91-b9c8-bb85750ff8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:15.173938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4469d-3a3b-4d91-b9c8-bb85750ff8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:15.175909 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4469d-3a3b-4d91-b9c8-bb85750ff8ed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:15.278793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1282/2588] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:46:15 2022] POST /identity/v3/projects => generated 357 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:15.283076 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fd3a0-ee92-4298-a4ca-c475e7acde64 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:15.294614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fd3a0-ee92-4298-a4ca-c475e7acde64 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:15.351657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4f6a-e3a9-42d4-8fb7-2ef936bd19c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:15.352306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4f6a-e3a9-42d4-8fb7-2ef936bd19c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:15.352615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4f6a-e3a9-42d4-8fb7-2ef936bd19c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:15.352992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4f6a-e3a9-42d4-8fb7-2ef936bd19c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:15.353507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c4f6a-e3a9-42d4-8fb7-2ef936bd19c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:15.355973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c4f6a-e3a9-42d4-8fb7-2ef936bd19c8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:15.484366 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1307/2589] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:46:15 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:15.488248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4469d-3a3b-4d91-b9c8-bb85750ff8ed admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:15.499210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4469d-3a3b-4d91-b9c8-bb85750ff8ed admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:15.504496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a333-4b98-4292-ad5e-082df57dddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:15.505147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a333-4b98-4292-ad5e-082df57dddb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:15.505442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a333-4b98-4292-ad5e-082df57dddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:15.505717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a333-4b98-4292-ad5e-082df57dddb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:15.506597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74a333-4b98-4292-ad5e-082df57dddb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:15.508694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74a333-4b98-4292-ad5e-082df57dddb5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:15.520887 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1283/2590] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:15.525394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4f6a-e3a9-42d4-8fb7-2ef936bd19c8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:15.535936 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4f6a-e3a9-42d4-8fb7-2ef936bd19c8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:15.540842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2d36-896b-4913-ac50-c07f4079aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:15.542170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2d36-896b-4913-ac50-c07f4079aca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:15.542686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2d36-896b-4913-ac50-c07f4079aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:15.542977 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2d36-896b-4913-ac50-c07f4079aca6 admin admin] PATH_INFO: `/v3/projects/14084c82808d42b892280c348e6a4e1f/users/56ac3051ffc74e3c85d2d534031f5963/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:15.559328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f2d36-896b-4913-ac50-c07f4079aca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14084c82808d42b892280c348e6a4e1f, user_id=56ac3051ffc74e3c85d2d534031f5963, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:15.562263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f2d36-896b-4913-ac50-c07f4079aca6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:15.645743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1308/2591] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:15 2022] PUT /identity/v3/projects/14084c82808d42b892280c348e6a4e1f/users/56ac3051ffc74e3c85d2d534031f5963/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:15.650316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a333-4b98-4292-ad5e-082df57dddb5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:15.661938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a333-4b98-4292-ad5e-082df57dddb5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:15.700233 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:15.747005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6207d7-6cea-4437-ac38-aee773c4563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:15.747005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6207d7-6cea-4437-ac38-aee773c4563d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:15.747005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6207d7-6cea-4437-ac38-aee773c4563d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:15.747005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6207d7-6cea-4437-ac38-aee773c4563d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:15.747484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6207d7-6cea-4437-ac38-aee773c4563d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:15.747484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6207d7-6cea-4437-ac38-aee773c4563d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:15.758764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1284/2592] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:46:15.762602 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2d36-896b-4913-ac50-c07f4079aca6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:15.778101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2d36-896b-4913-ac50-c07f4079aca6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:15.784285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:15.785148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:15.789151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:15.789151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] PATH_INFO: `/v3/projects/14084c82808d42b892280c348e6a4e1f/users/56ac3051ffc74e3c85d2d534031f5963/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:15.789151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=14084c82808d42b892280c348e6a4e1f, user_id=56ac3051ffc74e3c85d2d534031f5963, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:15.800454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:15.812201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1309/2593] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:15 2022] PUT /identity/v3/projects/14084c82808d42b892280c348e6a4e1f/users/56ac3051ffc74e3c85d2d534031f5963/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:15.822292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7f978-eb5e-427b-8c2d-ec67f5992e05 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:15.822633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7f978-eb5e-427b-8c2d-ec67f5992e05 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:15.822914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7f978-eb5e-427b-8c2d-ec67f5992e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:15.854667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cee7f978-eb5e-427b-8c2d-ec67f5992e05 None None] MFA Rules not processed for user `56ac3051ffc74e3c85d2d534031f5963`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:15.855885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cee7f978-eb5e-427b-8c2d-ec67f5992e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:15.925597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1285/2594] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:15.937393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:15.939238 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:15.997271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2802f5-5751-4813-af7d-db8b5572b98c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:16.000846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:16.001451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:16.001727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:16.001995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:16.011652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:16.013106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:16.022302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1310/2595] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:16.242352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7f978-eb5e-427b-8c2d-ec67f5992e05 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:16.243791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cee7f978-eb5e-427b-8c2d-ec67f5992e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:16.256644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7f978-eb5e-427b-8c2d-ec67f5992e05 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:16.260954 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:16.261557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:16.261833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:16.262102 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:16.320376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:16.321869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:16.331867 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1286/2596] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:17.058953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:17.069899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:17.105332 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:17.135010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7a6c2-ff30-4351-9cfe-33261fa0bfaa service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:17.140876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:17.141484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:17.141766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:17.142045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:17.143767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:17.156695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:17.158297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:17.170086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1311/2597] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:17.471724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:17.473174 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:17.530918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea083290-4d69-4d48-b6de-a547c84fe858 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:17.534594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:17.535202 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:17.535482 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:17.535754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:17.537554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:17.545213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:17.547485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:17.548950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:17.557190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1287/2598] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:25.546303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:25.556153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469d906-b506-47d1-ba97-55854d10d3c2 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:25.560339 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:25.560972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:25.561250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:25.561521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:25.563253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:25.642192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:25.643642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:25.654188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1312/2599] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:26.256918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:26.259357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:26.330557 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22ba3-009c-4bc6-b127-6bf83ce2495a service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:26.335658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:26.336270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:26.336581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:26.336861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:26.339225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:26.351289 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:26.352946 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:26.371300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1288/2600] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:26.396270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:26.397722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:26.419070 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a862ffa-4f03-49a6-8ec4-16c50a1be3fe service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:26.421742 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:26.422587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:26.422939 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:26.423320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] PATH_INFO: `/v3/users/0b4ee04a6c6d42fd9bc97d5e356d4a0a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:26.424722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4ee04a6c6d42fd9bc97d5e356d4a0a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:26.427764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:26.580199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4ee04a6c6d42fd9bc97d5e356d4a0a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:26.597481 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4ee04a6c6d42fd9bc97d5e356d4a0a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:26.605991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4ee04a6c6d42fd9bc97d5e356d4a0a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:26.694944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4ee04a6c6d42fd9bc97d5e356d4a0a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:26.695633 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-638af846-2c0c-4502-a62e-62cc12d366b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4ee04a6c6d42fd9bc97d5e356d4a0a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:26.702607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1313/2601] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:26 2022] DELETE /identity/v3/users/0b4ee04a6c6d42fd9bc97d5e356d4a0a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:26.958655 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:26.971569 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf825e-f432-4a88-8ce7-abb939cb2f7f service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:27.044775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:27.045415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.045698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.045976 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] PATH_INFO: `/v3/projects/f1bbde55bafa42108676212642d7d3bd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.047130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bbde55bafa42108676212642d7d3bd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:27.049095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:27.188579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bbde55bafa42108676212642d7d3bd', 'request_id': 'req-54423220-3a37-4ff9-a56b-f5de3879dc70'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:27.266142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bbde55bafa42108676212642d7d3bd', 'request_id': 'req-54423220-3a37-4ff9-a56b-f5de3879dc70'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:27.272815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bbde55bafa42108676212642d7d3bd', 'request_id': 'req-54423220-3a37-4ff9-a56b-f5de3879dc70'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:27.283861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] The token cache is being invalidate because project f1bbde55bafa42108676212642d7d3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:46:27.284151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:27.284821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-54423220-3a37-4ff9-a56b-f5de3879dc70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:27.286291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1289/2602] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:46:26 2022] DELETE /identity/v3/projects/f1bbde55bafa42108676212642d7d3bd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:27.291255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8123-18be-4450-a36d-36199610810f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.292054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8123-18be-4450-a36d-36199610810f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.292506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8123-18be-4450-a36d-36199610810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.313864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-33bb8123-18be-4450-a36d-36199610810f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:27.315189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33bb8123-18be-4450-a36d-36199610810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:27.342993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:27.377180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1314/2603] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:27.391515 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b78f4-32e7-4652-8575-3fe2e7830fd8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.391808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b78f4-32e7-4652-8575-3fe2e7830fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.392109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b78f4-32e7-4652-8575-3fe2e7830fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.412071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7f0b78f4-32e7-4652-8575-3fe2e7830fd8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:27.413343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7f0b78f4-32e7-4652-8575-3fe2e7830fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:27.422970 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1290/2604] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:27.428048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8123-18be-4450-a36d-36199610810f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:27.439676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8123-18be-4450-a36d-36199610810f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:27.444658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:27.445273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.445560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.445837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.446501 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:46:27.446810 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:27.449126 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:27.462096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1315/2605] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:46:27.465775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b78f4-32e7-4652-8575-3fe2e7830fd8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:27.475423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b78f4-32e7-4652-8575-3fe2e7830fd8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:27.481745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34e9c-5fdd-40d3-9cac-6b310fdde233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:27.485081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34e9c-5fdd-40d3-9cac-6b310fdde233 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.485081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34e9c-5fdd-40d3-9cac-6b310fdde233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.485081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34e9c-5fdd-40d3-9cac-6b310fdde233 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.485081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34e9c-5fdd-40d3-9cac-6b310fdde233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:27.485498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34e9c-5fdd-40d3-9cac-6b310fdde233 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:27.491657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:27.582352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1291/2606] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:46:27 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:27.586580 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:27.597348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b83556-b916-46d6-be7d-2f9e07df2258 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:27.655433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f73e-6fdd-4378-a2fd-a645d169eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:27.656049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f73e-6fdd-4378-a2fd-a645d169eae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.656333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f73e-6fdd-4378-a2fd-a645d169eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.656648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f73e-6fdd-4378-a2fd-a645d169eae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.657297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15f73e-6fdd-4378-a2fd-a645d169eae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:27.659495 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15f73e-6fdd-4378-a2fd-a645d169eae5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:27.772552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1316/2607] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:46:27 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:27.779195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34e9c-5fdd-40d3-9cac-6b310fdde233 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:27.789621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34e9c-5fdd-40d3-9cac-6b310fdde233 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:27.795268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7878d2a-0be0-4d50-b428-0e5b4a1a4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:27.795871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878d2a-0be0-4d50-b428-0e5b4a1a4491 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.796151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878d2a-0be0-4d50-b428-0e5b4a1a4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.796425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7878d2a-0be0-4d50-b428-0e5b4a1a4491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.797090 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7878d2a-0be0-4d50-b428-0e5b4a1a4491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:27.798703 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7878d2a-0be0-4d50-b428-0e5b4a1a4491 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:27.813152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1292/2608] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:27.814306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f73e-6fdd-4378-a2fd-a645d169eae5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:27.825744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f73e-6fdd-4378-a2fd-a645d169eae5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:27.829948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d247-ac6c-41ee-a5d8-c90d92ca03d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:27.830558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d247-ac6c-41ee-a5d8-c90d92ca03d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.830863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d247-ac6c-41ee-a5d8-c90d92ca03d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.831130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d247-ac6c-41ee-a5d8-c90d92ca03d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.831804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d247-ac6c-41ee-a5d8-c90d92ca03d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:27.833433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d247-ac6c-41ee-a5d8-c90d92ca03d1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:27.845467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1317/2609] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:27.849295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7878d2a-0be0-4d50-b428-0e5b4a1a4491 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:27.860326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7878d2a-0be0-4d50-b428-0e5b4a1a4491 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:27.864973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:27.865627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.865905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.866218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] PATH_INFO: `/v3/projects/c485eb8926d34ce3a021ca90bdd329c4/users/5fce93f39e3548048f1cc31e7466223f/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.881558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c485eb8926d34ce3a021ca90bdd329c4, user_id=5fce93f39e3548048f1cc31e7466223f, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:27.884224 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:27.953412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1293/2610] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:27 2022] PUT /identity/v3/projects/c485eb8926d34ce3a021ca90bdd329c4/users/5fce93f39e3548048f1cc31e7466223f/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:27.965386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de1796-0167-438c-86dd-2cbe2580e53b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:27.965672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de1796-0167-438c-86dd-2cbe2580e53b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:27.965956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de1796-0167-438c-86dd-2cbe2580e53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:27.998843 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-14de1796-0167-438c-86dd-2cbe2580e53b None None] MFA Rules not processed for user `5fce93f39e3548048f1cc31e7466223f`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:28.000090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-14de1796-0167-438c-86dd-2cbe2580e53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:28.066068 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1318/2611] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:28.078267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:28.079998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:28.144187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe06c6-b0bb-4496-bfd1-cf632bc4844a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:28.147829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488d32b-63bf-465e-9f00-889a163fafbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:28.148432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488d32b-63bf-465e-9f00-889a163fafbe service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:28.148737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488d32b-63bf-465e-9f00-889a163fafbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:28.149009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488d32b-63bf-465e-9f00-889a163fafbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:28.157830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488d32b-63bf-465e-9f00-889a163fafbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:28.159236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488d32b-63bf-465e-9f00-889a163fafbe service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:28.167990 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1294/2612] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:38.063093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:38.163917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:54.158764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de1796-0167-438c-86dd-2cbe2580e53b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:54.225979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de1796-0167-438c-86dd-2cbe2580e53b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:54.230560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:54.231215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:54.231619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:54.231897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] PATH_INFO: `/v3/users/5fce93f39e3548048f1cc31e7466223f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:54.233100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fce93f39e3548048f1cc31e7466223f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:54.235046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:54.441593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fce93f39e3548048f1cc31e7466223f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:54.454647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fce93f39e3548048f1cc31e7466223f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:54.461960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fce93f39e3548048f1cc31e7466223f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:54.569738 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fce93f39e3548048f1cc31e7466223f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:54.570373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fce93f39e3548048f1cc31e7466223f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:54.577096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1319/2613] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:54 2022] DELETE /identity/v3/users/5fce93f39e3548048f1cc31e7466223f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:54.581794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f4fc5-c27a-4ea3-b674-34d6078dc8b2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:54.582315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f4fc5-c27a-4ea3-b674-34d6078dc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:54.582544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f4fc5-c27a-4ea3-b674-34d6078dc8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:54.602116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e00f4fc5-c27a-4ea3-b674-34d6078dc8b2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:54.604078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e00f4fc5-c27a-4ea3-b674-34d6078dc8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:54.663510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1295/2614] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:46:54.673993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:54.675422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:54.740964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c3ca-25fd-45b2-bd73-61bd53719adf admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:54.744702 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:54.752025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:54.752025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:54.752025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:54.760687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:54.762129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:54.776526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1320/2615] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:55.209311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f4fc5-c27a-4ea3-b674-34d6078dc8b2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:55.210820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e00f4fc5-c27a-4ea3-b674-34d6078dc8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:55.225859 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f4fc5-c27a-4ea3-b674-34d6078dc8b2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:55.226352 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:55.227969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:55.233340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:55.234261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:55.234613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:55.235190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] PATH_INFO: `/v3/users/444a812051884eea83f92bb39ede3278` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:55.237353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=444a812051884eea83f92bb39ede3278)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:55.240749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:55.242668 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae4a90-6ad7-42ec-b7f0-11674cb578cf service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:55.248402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:55.249696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:55.250029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:55.250290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] PATH_INFO: `/v3/projects/c485eb8926d34ce3a021ca90bdd329c4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:55.252682 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c485eb8926d34ce3a021ca90bdd329c4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:55.255722 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:55.280346 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:55.413425 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444a812051884eea83f92bb39ede3278'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.415294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c485eb8926d34ce3a021ca90bdd329c4', 'request_id': 'req-d233aff9-b02d-4bc8-9d63-11699b73ce82'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.421047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444a812051884eea83f92bb39ede3278'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.421664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c485eb8926d34ce3a021ca90bdd329c4', 'request_id': 'req-d233aff9-b02d-4bc8-9d63-11699b73ce82'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.428172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c485eb8926d34ce3a021ca90bdd329c4', 'request_id': 'req-d233aff9-b02d-4bc8-9d63-11699b73ce82'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.438336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444a812051884eea83f92bb39ede3278'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.506295 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] The token cache is being invalidate because project c485eb8926d34ce3a021ca90bdd329c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:46:55.506592 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.507244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.508886 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1321/2616] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:46:55 2022] DELETE /identity/v3/projects/c485eb8926d34ce3a021ca90bdd329c4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:55.520632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:55.520632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:55.584530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233aff9-b02d-4bc8-9d63-11699b73ce82 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:55.587459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444a812051884eea83f92bb39ede3278'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.588849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-688ecc3b-db2d-4809-9791-50bfed9f8451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444a812051884eea83f92bb39ede3278'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.590584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:55.592301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:55.592663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:55.592922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] PATH_INFO: `/v3/users/c5f4ad7cb6ae4de0b656922fdc27bc4e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:55.594175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f4ad7cb6ae4de0b656922fdc27bc4e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:55.596176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:55.604939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1296/2617] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:55 2022] DELETE /identity/v3/users/444a812051884eea83f92bb39ede3278 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:55.610720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4b51-dead-4b84-aa99-44451d47fc26 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:55.610720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4b51-dead-4b84-aa99-44451d47fc26 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:55.610720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4b51-dead-4b84-aa99-44451d47fc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:55.635206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d40e4b51-dead-4b84-aa99-44451d47fc26 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:55.636595 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d40e4b51-dead-4b84-aa99-44451d47fc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:55.705717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1297/2618] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:55.716085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e4b51-dead-4b84-aa99-44451d47fc26 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:55.717752 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d40e4b51-dead-4b84-aa99-44451d47fc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:55.733546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:55.735227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f4ad7cb6ae4de0b656922fdc27bc4e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.748860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f4ad7cb6ae4de0b656922fdc27bc4e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.759871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f4ad7cb6ae4de0b656922fdc27bc4e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.778745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e4b51-dead-4b84-aa99-44451d47fc26 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:55.782692 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab88bb-4b42-467d-a875-e4a5adde9852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:55.783301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab88bb-4b42-467d-a875-e4a5adde9852 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:55.783579 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab88bb-4b42-467d-a875-e4a5adde9852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:55.783852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab88bb-4b42-467d-a875-e4a5adde9852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:55.793633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab88bb-4b42-467d-a875-e4a5adde9852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:55.795094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab88bb-4b42-467d-a875-e4a5adde9852 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:55.805007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1298/2619] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:46:55.838102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f4ad7cb6ae4de0b656922fdc27bc4e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.846118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f4ad7cb6ae4de0b656922fdc27bc4e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:55.846118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1322/2620] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:55 2022] DELETE /identity/v3/users/c5f4ad7cb6ae4de0b656922fdc27bc4e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:55.850144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236e4e6-2960-4e5c-8801-53d6b9691af2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:55.850427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236e4e6-2960-4e5c-8801-53d6b9691af2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:55.850700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236e4e6-2960-4e5c-8801-53d6b9691af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:55.869951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b236e4e6-2960-4e5c-8801-53d6b9691af2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:55.874225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b236e4e6-2960-4e5c-8801-53d6b9691af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:55.931284 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1299/2621] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:55.941849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:55.943276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:55.972563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:56.002303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b812461-3c87-4f5b-a34e-022fe7fa95a4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:56.006265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:56.006881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:56.007164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:56.007444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:56.017829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:56.019274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:56.029680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1323/2622] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:56.304173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236e4e6-2960-4e5c-8801-53d6b9691af2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:56.306329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b236e4e6-2960-4e5c-8801-53d6b9691af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:56.341568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236e4e6-2960-4e5c-8801-53d6b9691af2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:56.352915 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:56.353564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:56.353845 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:56.354117 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] PATH_INFO: `/v3/projects/c62ccc6bece3452ebd107455844e7d10` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:56.355263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62ccc6bece3452ebd107455844e7d10)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:56.358136 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:56.455398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62ccc6bece3452ebd107455844e7d10', 'request_id': 'req-71e82266-36a6-4124-baa0-d532debe4474'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.549449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:56.550995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:56.565236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a9f4-b2b1-4cb9-9df0-7a6dc941b022 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:56.575971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62ccc6bece3452ebd107455844e7d10', 'request_id': 'req-71e82266-36a6-4124-baa0-d532debe4474'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.587899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62ccc6bece3452ebd107455844e7d10', 'request_id': 'req-71e82266-36a6-4124-baa0-d532debe4474'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.602413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] The token cache is being invalidate because project c62ccc6bece3452ebd107455844e7d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:46:56.602631 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.603305 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-71e82266-36a6-4124-baa0-d532debe4474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.604827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1300/2623] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:46:56 2022] DELETE /identity/v3/projects/c62ccc6bece3452ebd107455844e7d10 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:56.611625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98029f5b-2d09-453b-8938-ddfa91485abe None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:56.611818 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98029f5b-2d09-453b-8938-ddfa91485abe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:56.617238 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98029f5b-2d09-453b-8938-ddfa91485abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:56.642525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-98029f5b-2d09-453b-8938-ddfa91485abe None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:56.643824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-98029f5b-2d09-453b-8938-ddfa91485abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:56.644701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:56.645337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:56.645619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:56.646012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] PATH_INFO: `/v3/projects/8c12026f97334cb2ad7eefe1148e3621` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:56.647056 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c12026f97334cb2ad7eefe1148e3621)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:56.649031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:56.660009 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1301/2624] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:56.670649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94ecc7-6ae7-45cf-b4b2-61e3b5174709 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:56.670930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94ecc7-6ae7-45cf-b4b2-61e3b5174709 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:56.671253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94ecc7-6ae7-45cf-b4b2-61e3b5174709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:56.691627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7c94ecc7-6ae7-45cf-b4b2-61e3b5174709 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:56.692802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c94ecc7-6ae7-45cf-b4b2-61e3b5174709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:56.700996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1302/2625] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:56.705011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94ecc7-6ae7-45cf-b4b2-61e3b5174709 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:56.714051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94ecc7-6ae7-45cf-b4b2-61e3b5174709 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:56.719330 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:56.719911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:56.724543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:56.724543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:56.724543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:46:56.724543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:56.724543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:56.735388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1303/2626] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:46:56.739871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:56.751373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deeb33-278b-4823-a741-9e2f0e3136ec admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:56.753401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c12026f97334cb2ad7eefe1148e3621', 'request_id': 'req-e70adbdf-da87-4809-a9d7-f019753b7aa1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.759656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c12026f97334cb2ad7eefe1148e3621', 'request_id': 'req-e70adbdf-da87-4809-a9d7-f019753b7aa1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.761852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:56.767120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c12026f97334cb2ad7eefe1148e3621', 'request_id': 'req-e70adbdf-da87-4809-a9d7-f019753b7aa1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.815267 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:56.816039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:56.816226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:56.816435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:56.817525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:56.820690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:56.824082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] The token cache is being invalidate because project 8c12026f97334cb2ad7eefe1148e3621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:46:56.824561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.825830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:56.827910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1324/2627] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:46:56 2022] DELETE /identity/v3/projects/8c12026f97334cb2ad7eefe1148e3621 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:46:56.831441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:56.832941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:56.847256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adbdf-da87-4809-a9d7-f019753b7aa1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:56.851925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:56.852640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:56.852869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:56.853147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] PATH_INFO: `/v3/users/56ac3051ffc74e3c85d2d534031f5963` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:56.854361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ac3051ffc74e3c85d2d534031f5963)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:56.856373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:56.948718 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1304/2628] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:46:56 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:46:56.953439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:56.955039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:57.019627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e8262-fefc-4723-a2d0-ff11304f2a1b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:57.024501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079465a-85a3-4889-bc45-2de1dd1a5efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:57.027548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079465a-85a3-4889-bc45-2de1dd1a5efd admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:57.027548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079465a-85a3-4889-bc45-2de1dd1a5efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:57.027548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079465a-85a3-4889-bc45-2de1dd1a5efd admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:57.027548 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079465a-85a3-4889-bc45-2de1dd1a5efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:57.029030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079465a-85a3-4889-bc45-2de1dd1a5efd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:57.036045 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ac3051ffc74e3c85d2d534031f5963'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.041616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:57.049948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ac3051ffc74e3c85d2d534031f5963'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.056802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ac3051ffc74e3c85d2d534031f5963'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.079814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1305/2629] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:46:56 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:46:57.082852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079465a-85a3-4889-bc45-2de1dd1a5efd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:57.093329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079465a-85a3-4889-bc45-2de1dd1a5efd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:57.098030 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914e064-25b1-4223-8159-e8d5f8a878e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:57.098612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e064-25b1-4223-8159-e8d5f8a878e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:57.098894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e064-25b1-4223-8159-e8d5f8a878e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:57.099191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e064-25b1-4223-8159-e8d5f8a878e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:57.099830 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e064-25b1-4223-8159-e8d5f8a878e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:57.101449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e064-25b1-4223-8159-e8d5f8a878e7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:57.111413 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1306/2630] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:46:57.115294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914e064-25b1-4223-8159-e8d5f8a878e7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:57.125639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914e064-25b1-4223-8159-e8d5f8a878e7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:57.130513 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb7928-b2e6-4202-98f8-6be24538372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:57.131075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7928-b2e6-4202-98f8-6be24538372c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:57.131355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7928-b2e6-4202-98f8-6be24538372c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:57.131630 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7928-b2e6-4202-98f8-6be24538372c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:57.132242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb7928-b2e6-4202-98f8-6be24538372c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:57.133810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb7928-b2e6-4202-98f8-6be24538372c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:57.145159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1307/2631] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:46:57.150323 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb7928-b2e6-4202-98f8-6be24538372c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:57.158142 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ac3051ffc74e3c85d2d534031f5963'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.158812 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-115e47b5-058e-4e7e-b778-3625c09111b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ac3051ffc74e3c85d2d534031f5963'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.161257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb7928-b2e6-4202-98f8-6be24538372c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:57.165287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1325/2632] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:56 2022] DELETE /identity/v3/users/56ac3051ffc74e3c85d2d534031f5963 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:46:57.166620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:57.167318 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:57.167611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:57.167930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] PATH_INFO: `/v3/projects/80fe69dc238e422c83dd0e748e4cf023/users/f68c018ac43b4b4fbfb2ef3e9e914a95/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:57.190392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fe69dc238e422c83dd0e748e4cf023, user_id=f68c018ac43b4b4fbfb2ef3e9e914a95, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:57.193156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:57.250875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1308/2633] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:57 2022] PUT /identity/v3/projects/80fe69dc238e422c83dd0e748e4cf023/users/f68c018ac43b4b4fbfb2ef3e9e914a95/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:46:57.318420 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6307d3-475c-4c2f-8b65-0b4f3fce379d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:57.318748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6307d3-475c-4c2f-8b65-0b4f3fce379d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:57.318974 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6307d3-475c-4c2f-8b65-0b4f3fce379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:57.348733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8d6307d3-475c-4c2f-8b65-0b4f3fce379d None None] MFA Rules not processed for user `f68c018ac43b4b4fbfb2ef3e9e914a95`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:57.350111 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8d6307d3-475c-4c2f-8b65-0b4f3fce379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:57.426870 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1326/2634] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:57.438293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:57.440084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:57.492973 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:57.505419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997330f-7371-4e8f-b876-aad04a880a41 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:57.513834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fe35a-7d88-4d47-9b5b-68da605cc915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:57.513834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe35a-7d88-4d47-9b5b-68da605cc915 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:57.513834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe35a-7d88-4d47-9b5b-68da605cc915 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:57.513834 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe35a-7d88-4d47-9b5b-68da605cc915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:57.519147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fe35a-7d88-4d47-9b5b-68da605cc915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:57.520748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fe35a-7d88-4d47-9b5b-68da605cc915 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:57.529981 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1309/2635] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:57.600995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6307d3-475c-4c2f-8b65-0b4f3fce379d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:57.602526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8d6307d3-475c-4c2f-8b65-0b4f3fce379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:57.675368 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6307d3-475c-4c2f-8b65-0b4f3fce379d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:57.680398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:57.684096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:57.684096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:57.684096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] PATH_INFO: `/v3/projects/14084c82808d42b892280c348e6a4e1f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:57.684096 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14084c82808d42b892280c348e6a4e1f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:57.686277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:57.832983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14084c82808d42b892280c348e6a4e1f', 'request_id': 'req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.838537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14084c82808d42b892280c348e6a4e1f', 'request_id': 'req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.840433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:57.845012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14084c82808d42b892280c348e6a4e1f', 'request_id': 'req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.953952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] The token cache is being invalidate because project 14084c82808d42b892280c348e6a4e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:46:57.954286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.955236 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8b5922c-935f-4020-8aa2-f8f3ad4bfca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:57.957521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1327/2636] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:46:57 2022] DELETE /identity/v3/projects/14084c82808d42b892280c348e6a4e1f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:57.962405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b88b2-a095-44b7-8d12-4281bb9009a2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:57.962926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b88b2-a095-44b7-8d12-4281bb9009a2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:57.963036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b88b2-a095-44b7-8d12-4281bb9009a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:57.987132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-236b88b2-a095-44b7-8d12-4281bb9009a2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:57.988338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-236b88b2-a095-44b7-8d12-4281bb9009a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:58.048537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1310/2637] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:58.057543 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2431d-5578-4e61-8e22-ffa33213531b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.057855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2431d-5578-4e61-8e22-ffa33213531b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.058137 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2431d-5578-4e61-8e22-ffa33213531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.079680 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-80f2431d-5578-4e61-8e22-ffa33213531b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:58.080933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-80f2431d-5578-4e61-8e22-ffa33213531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:58.088973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1328/2638] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:58.094119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b88b2-a095-44b7-8d12-4281bb9009a2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:58.104024 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b88b2-a095-44b7-8d12-4281bb9009a2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:58.109445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:58.110053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.110340 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.110653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.111352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:46:58.111668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:58.113302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:58.126213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1311/2639] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:46:58.131012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2431d-5578-4e61-8e22-ffa33213531b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:58.140539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2431d-5578-4e61-8e22-ffa33213531b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:58.145241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1dc9e-8efd-413b-b467-21c1b37228d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:58.145942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1dc9e-8efd-413b-b467-21c1b37228d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.146226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1dc9e-8efd-413b-b467-21c1b37228d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.146504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1dc9e-8efd-413b-b467-21c1b37228d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.147143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1dc9e-8efd-413b-b467-21c1b37228d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:58.149138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1dc9e-8efd-413b-b467-21c1b37228d4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:58.250412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1329/2640] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:46:58 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:58.251814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:58.264652 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf953f-ce4c-47b4-997a-46f3dd0253db admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:58.323489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22bce0-1298-4f05-8cc0-f94b20aeaa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:58.324108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22bce0-1298-4f05-8cc0-f94b20aeaa78 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.324387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22bce0-1298-4f05-8cc0-f94b20aeaa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.324698 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22bce0-1298-4f05-8cc0-f94b20aeaa78 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.326141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22bce0-1298-4f05-8cc0-f94b20aeaa78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:58.328258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22bce0-1298-4f05-8cc0-f94b20aeaa78 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:58.404778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1312/2641] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:46:58 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:58.408798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1dc9e-8efd-413b-b467-21c1b37228d4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:58.419667 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1dc9e-8efd-413b-b467-21c1b37228d4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:58.424362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f177f0-9f17-4706-8ab8-7599d8699580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:58.425615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f177f0-9f17-4706-8ab8-7599d8699580 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.425615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f177f0-9f17-4706-8ab8-7599d8699580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.425615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f177f0-9f17-4706-8ab8-7599d8699580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.426164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f177f0-9f17-4706-8ab8-7599d8699580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:58.427768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f177f0-9f17-4706-8ab8-7599d8699580 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:58.439388 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1330/2642] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:58.443248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22bce0-1298-4f05-8cc0-f94b20aeaa78 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:58.453344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22bce0-1298-4f05-8cc0-f94b20aeaa78 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:58.457961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934396-b880-4106-998e-87135cb62e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:58.458539 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934396-b880-4106-998e-87135cb62e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.458816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934396-b880-4106-998e-87135cb62e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.459087 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934396-b880-4106-998e-87135cb62e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.459773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a934396-b880-4106-998e-87135cb62e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:58.461378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a934396-b880-4106-998e-87135cb62e30 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:58.472203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1313/2643] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:58.476011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f177f0-9f17-4706-8ab8-7599d8699580 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:58.487769 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f177f0-9f17-4706-8ab8-7599d8699580 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:58.492657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8fbf2-d2f1-4592-a39e-f7a0274bc940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:58.493311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8fbf2-d2f1-4592-a39e-f7a0274bc940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.493589 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8fbf2-d2f1-4592-a39e-f7a0274bc940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.493860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8fbf2-d2f1-4592-a39e-f7a0274bc940 admin admin] PATH_INFO: `/v3/projects/a15ee4d778864ba8b1b2062266409c64/users/02d8a37ebc824cde838d8d8d0056c4a4/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.509829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8fbf2-d2f1-4592-a39e-f7a0274bc940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15ee4d778864ba8b1b2062266409c64, user_id=02d8a37ebc824cde838d8d8d0056c4a4, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:58.512551 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8fbf2-d2f1-4592-a39e-f7a0274bc940 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:58.604150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1331/2644] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:58 2022] PUT /identity/v3/projects/a15ee4d778864ba8b1b2062266409c64/users/02d8a37ebc824cde838d8d8d0056c4a4/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:58.615556 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a3d2-e0dc-4f80-9b5c-22db2fbecdb5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.615846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a3d2-e0dc-4f80-9b5c-22db2fbecdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.616125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a3d2-e0dc-4f80-9b5c-22db2fbecdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.644788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7fe3a3d2-e0dc-4f80-9b5c-22db2fbecdb5 None None] MFA Rules not processed for user `02d8a37ebc824cde838d8d8d0056c4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:58.646011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7fe3a3d2-e0dc-4f80-9b5c-22db2fbecdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:58.686449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:58.710131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1314/2645] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:58.714622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8fbf2-d2f1-4592-a39e-f7a0274bc940 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:58.780237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8fbf2-d2f1-4592-a39e-f7a0274bc940 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:58.785149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8896e-38f7-4370-b3ac-4ac7d5aa9fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:58.785919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8896e-38f7-4370-b3ac-4ac7d5aa9fab admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.786285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8896e-38f7-4370-b3ac-4ac7d5aa9fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.786569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8896e-38f7-4370-b3ac-4ac7d5aa9fab admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.787224 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8896e-38f7-4370-b3ac-4ac7d5aa9fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:58.789468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8896e-38f7-4370-b3ac-4ac7d5aa9fab admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:58.862862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1332/2646] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:46:58 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:58.866918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a3d2-e0dc-4f80-9b5c-22db2fbecdb5 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:58.877403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a3d2-e0dc-4f80-9b5c-22db2fbecdb5 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:58.938119 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1614c-090a-4ebb-b371-ee8dbcf27943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:58.938656 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1614c-090a-4ebb-b371-ee8dbcf27943 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:58.938938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1614c-090a-4ebb-b371-ee8dbcf27943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:58.939213 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1614c-090a-4ebb-b371-ee8dbcf27943 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:58.939882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1614c-090a-4ebb-b371-ee8dbcf27943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:58.941811 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1614c-090a-4ebb-b371-ee8dbcf27943 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:59.017188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1315/2647] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:46:58 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:46:59.025559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8896e-38f7-4370-b3ac-4ac7d5aa9fab admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:59.036607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8896e-38f7-4370-b3ac-4ac7d5aa9fab admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:59.041255 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f748416-6f9b-4cd4-b2dc-c69abead8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:59.041853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f748416-6f9b-4cd4-b2dc-c69abead8b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:59.042215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f748416-6f9b-4cd4-b2dc-c69abead8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:59.042463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f748416-6f9b-4cd4-b2dc-c69abead8b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:59.043104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f748416-6f9b-4cd4-b2dc-c69abead8b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:59.044857 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f748416-6f9b-4cd4-b2dc-c69abead8b86 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:59.055442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1333/2648] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:59.059499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1614c-090a-4ebb-b371-ee8dbcf27943 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:59.069419 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1614c-090a-4ebb-b371-ee8dbcf27943 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:59.074006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d02346-5e5d-4993-9629-46fa4c48544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:59.074683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d02346-5e5d-4993-9629-46fa4c48544e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:59.074964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d02346-5e5d-4993-9629-46fa4c48544e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:59.075747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d02346-5e5d-4993-9629-46fa4c48544e admin admin] PATH_INFO: `/v3/projects/85bea9b8fb584b68bfd14e0a11ec71bf/users/f952087284a945ad8768ced2480cbc69/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:59.099456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d02346-5e5d-4993-9629-46fa4c48544e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bea9b8fb584b68bfd14e0a11ec71bf, user_id=f952087284a945ad8768ced2480cbc69, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:59.099456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d02346-5e5d-4993-9629-46fa4c48544e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:59.181658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1316/2649] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:59 2022] PUT /identity/v3/projects/85bea9b8fb584b68bfd14e0a11ec71bf/users/f952087284a945ad8768ced2480cbc69/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:59.186672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f748416-6f9b-4cd4-b2dc-c69abead8b86 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:59.196788 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f748416-6f9b-4cd4-b2dc-c69abead8b86 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:59.253576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c67ab-72f4-413e-83bf-1f8dedd8c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:59.254202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c67ab-72f4-413e-83bf-1f8dedd8c407 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:59.254752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c67ab-72f4-413e-83bf-1f8dedd8c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:59.255032 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c67ab-72f4-413e-83bf-1f8dedd8c407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:59.255673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c67ab-72f4-413e-83bf-1f8dedd8c407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:59.257344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c67ab-72f4-413e-83bf-1f8dedd8c407 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:59.258586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:59.268214 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1334/2650] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:46:59.275778 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d02346-5e5d-4993-9629-46fa4c48544e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:59.283209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d02346-5e5d-4993-9629-46fa4c48544e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:59.287708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:59.288355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:59.288699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:59.288969 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] PATH_INFO: `/v3/projects/85bea9b8fb584b68bfd14e0a11ec71bf/users/f952087284a945ad8768ced2480cbc69/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:59.290846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bea9b8fb584b68bfd14e0a11ec71bf, user_id=f952087284a945ad8768ced2480cbc69, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:59.293468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:59.304254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1317/2651] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:46:59 2022] PUT /identity/v3/projects/85bea9b8fb584b68bfd14e0a11ec71bf/users/f952087284a945ad8768ced2480cbc69/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:46:59.315468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257506b2-db1a-462c-ac4f-82addaa4285b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:59.315903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257506b2-db1a-462c-ac4f-82addaa4285b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:59.316306 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257506b2-db1a-462c-ac4f-82addaa4285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:59.345473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-257506b2-db1a-462c-ac4f-82addaa4285b None None] MFA Rules not processed for user `f952087284a945ad8768ced2480cbc69`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:59.346701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-257506b2-db1a-462c-ac4f-82addaa4285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:59.428201 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1335/2652] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:46:59.462291 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:59.464219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:59.532817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155cfcd-a910-48a3-8b7b-c0fd22588f26 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:59.536666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a362752-d3ee-4141-ad30-cc52f47e6889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:59.537360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362752-d3ee-4141-ad30-cc52f47e6889 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:59.537646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362752-d3ee-4141-ad30-cc52f47e6889 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:59.537922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362752-d3ee-4141-ad30-cc52f47e6889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:59.547472 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a362752-d3ee-4141-ad30-cc52f47e6889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:59.548958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a362752-d3ee-4141-ad30-cc52f47e6889 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:59.559409 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1318/2653] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:46:59.590225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257506b2-db1a-462c-ac4f-82addaa4285b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:46:59.655294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257506b2-db1a-462c-ac4f-82addaa4285b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:46:59.660112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:46:59.660811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:59.661100 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:59.664029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] PATH_INFO: `/v3/users/02d8a37ebc824cde838d8d8d0056c4a4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:59.664029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d8a37ebc824cde838d8d8d0056c4a4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:46:59.664540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:46:59.830155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d8a37ebc824cde838d8d8d0056c4a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:59.842129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d8a37ebc824cde838d8d8d0056c4a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:59.849221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d8a37ebc824cde838d8d8d0056c4a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:59.918178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d8a37ebc824cde838d8d8d0056c4a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:59.919325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d8a37ebc824cde838d8d8d0056c4a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:46:59.921662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:59.926208 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1336/2654] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:46:59 2022] DELETE /identity/v3/users/02d8a37ebc824cde838d8d8d0056c4a4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:46:59.930744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b9e2-8f9c-4fc7-8e66-c5e20468fe81 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:46:59.931029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b9e2-8f9c-4fc7-8e66-c5e20468fe81 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:46:59.931302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572b9e2-8f9c-4fc7-8e66-c5e20468fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:46:59.950522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9572b9e2-8f9c-4fc7-8e66-c5e20468fe81 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:46:59.951738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9572b9e2-8f9c-4fc7-8e66-c5e20468fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:46:59.986210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:00.017308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1319/2655] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:00.027405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:00.028969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:00.087973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629f6c1-ae5d-405e-bf7a-ad029d8a667c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:00.091991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762db3-3a30-41e2-a9a8-1929516c714f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:00.092635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762db3-3a30-41e2-a9a8-1929516c714f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:00.092918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762db3-3a30-41e2-a9a8-1929516c714f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:00.093192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762db3-3a30-41e2-a9a8-1929516c714f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:00.102621 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1762db3-3a30-41e2-a9a8-1929516c714f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:00.104057 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1762db3-3a30-41e2-a9a8-1929516c714f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:00.114205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1337/2656] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:00.543050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572b9e2-8f9c-4fc7-8e66-c5e20468fe81 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:00.545194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9572b9e2-8f9c-4fc7-8e66-c5e20468fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:00.559627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572b9e2-8f9c-4fc7-8e66-c5e20468fe81 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:00.565618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:00.566292 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:00.566643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:00.566993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] PATH_INFO: `/v3/projects/a15ee4d778864ba8b1b2062266409c64` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:00.568342 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15ee4d778864ba8b1b2062266409c64)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:00.570421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:00.667726 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15ee4d778864ba8b1b2062266409c64', 'request_id': 'req-42a827fd-3140-43dd-b714-dd14a7e0e29c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:00.746708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15ee4d778864ba8b1b2062266409c64', 'request_id': 'req-42a827fd-3140-43dd-b714-dd14a7e0e29c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:00.754295 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15ee4d778864ba8b1b2062266409c64', 'request_id': 'req-42a827fd-3140-43dd-b714-dd14a7e0e29c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:00.765668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] The token cache is being invalidate because project a15ee4d778864ba8b1b2062266409c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:00.765962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:00.766618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:00.768245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1320/2657] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:00 2022] DELETE /identity/v3/projects/a15ee4d778864ba8b1b2062266409c64 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:00.772471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762db3-3a30-41e2-a9a8-1929516c714f service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:00.783584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762db3-3a30-41e2-a9a8-1929516c714f service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:00.840049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:00.840630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:00.841470 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:00.841781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] PATH_INFO: `/v3/users/f952087284a945ad8768ced2480cbc69` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:00.842985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f952087284a945ad8768ced2480cbc69)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:00.844958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:01.078535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f952087284a945ad8768ced2480cbc69'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:01.101520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f952087284a945ad8768ced2480cbc69'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:01.111034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f952087284a945ad8768ced2480cbc69'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:01.192637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f952087284a945ad8768ced2480cbc69'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:01.193288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-16913d5d-5a93-4c26-af50-bc7ddb3dc705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f952087284a945ad8768ced2480cbc69'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:01.207130 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1338/2658] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:00 2022] DELETE /identity/v3/users/f952087284a945ad8768ced2480cbc69 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:01.714814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:01.718666 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:01.734331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a827fd-3140-43dd-b714-dd14a7e0e29c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:01.805623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:01.806276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:01.806558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:01.806836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] PATH_INFO: `/v3/projects/85bea9b8fb584b68bfd14e0a11ec71bf` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:01.808070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bea9b8fb584b68bfd14e0a11ec71bf)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:01.810303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:01.934486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bea9b8fb584b68bfd14e0a11ec71bf', 'request_id': 'req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:02.027051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bea9b8fb584b68bfd14e0a11ec71bf', 'request_id': 'req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:02.035750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bea9b8fb584b68bfd14e0a11ec71bf', 'request_id': 'req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:02.037097 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:02.047566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] The token cache is being invalidate because project 85bea9b8fb584b68bfd14e0a11ec71bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:02.047855 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:02.048671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1a4fa898-611a-4f5c-b9b8-0c06da7b37ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:02.050500 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1321/2659] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:01 2022] DELETE /identity/v3/projects/85bea9b8fb584b68bfd14e0a11ec71bf => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:02.056284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7aac5-e589-47fe-b29b-5f0424b44c63 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.056837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7aac5-e589-47fe-b29b-5f0424b44c63 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.056947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7aac5-e589-47fe-b29b-5f0424b44c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.077555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-90a7aac5-e589-47fe-b29b-5f0424b44c63 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:02.078814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-90a7aac5-e589-47fe-b29b-5f0424b44c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:02.096716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:02.140135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1339/2660] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:02.148955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d26b-c6d2-4506-bdb2-116926a60d2e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.154063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d26b-c6d2-4506-bdb2-116926a60d2e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.154063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d26b-c6d2-4506-bdb2-116926a60d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.170535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-efe1d26b-c6d2-4506-bdb2-116926a60d2e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:02.171753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-efe1d26b-c6d2-4506-bdb2-116926a60d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:02.179671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1322/2661] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:47:02.183861 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7aac5-e589-47fe-b29b-5f0424b44c63 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:02.193584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7aac5-e589-47fe-b29b-5f0424b44c63 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:02.198209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:02.198809 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.199091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.199371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.200018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:47:02.201031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:02.202922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:02.215436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1340/2662] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:47:02.220334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1d26b-c6d2-4506-bdb2-116926a60d2e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:02.229472 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1d26b-c6d2-4506-bdb2-116926a60d2e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:02.234364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c76bb-4c99-47cf-a1be-18aa68f08d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:02.234948 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c76bb-4c99-47cf-a1be-18aa68f08d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.235228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c76bb-4c99-47cf-a1be-18aa68f08d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.235492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c76bb-4c99-47cf-a1be-18aa68f08d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.236147 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c76bb-4c99-47cf-a1be-18aa68f08d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:02.238020 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c76bb-4c99-47cf-a1be-18aa68f08d3a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:02.311247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1323/2663] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:02 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:02.312659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:02.322536 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3335d83-527b-4a70-bfe1-01aedd769b3c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:02.380710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec4f0-5c59-410c-8089-9e133b3a926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:02.381328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec4f0-5c59-410c-8089-9e133b3a926f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.381614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec4f0-5c59-410c-8089-9e133b3a926f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.381914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec4f0-5c59-410c-8089-9e133b3a926f admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.382544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fec4f0-5c59-410c-8089-9e133b3a926f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:02.384445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fec4f0-5c59-410c-8089-9e133b3a926f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:02.461959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1341/2664] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:02 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:02.466216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c76bb-4c99-47cf-a1be-18aa68f08d3a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:02.476414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c76bb-4c99-47cf-a1be-18aa68f08d3a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:02.481540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959672d5-ff1e-4184-bd74-8b1c09e30b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:02.482275 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959672d5-ff1e-4184-bd74-8b1c09e30b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.488156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959672d5-ff1e-4184-bd74-8b1c09e30b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.488156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959672d5-ff1e-4184-bd74-8b1c09e30b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.488156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959672d5-ff1e-4184-bd74-8b1c09e30b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:02.488156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959672d5-ff1e-4184-bd74-8b1c09e30b5f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:02.496227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1324/2665] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:02.500925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec4f0-5c59-410c-8089-9e133b3a926f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:02.511373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec4f0-5c59-410c-8089-9e133b3a926f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:02.516912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02684-6768-4327-b2f7-7c6176eee7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:02.517515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02684-6768-4327-b2f7-7c6176eee7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.517800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02684-6768-4327-b2f7-7c6176eee7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.518077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02684-6768-4327-b2f7-7c6176eee7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.518724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c02684-6768-4327-b2f7-7c6176eee7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:02.520319 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c02684-6768-4327-b2f7-7c6176eee7b4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:02.531309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1342/2666] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:02.535614 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959672d5-ff1e-4184-bd74-8b1c09e30b5f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:02.552014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959672d5-ff1e-4184-bd74-8b1c09e30b5f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:02.556827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:02.557484 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.557768 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.558046 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] PATH_INFO: `/v3/projects/ad8bb0f301814484a078326bfe41c492/users/c081bd38722144749b58054c5cb645b2/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.573658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8bb0f301814484a078326bfe41c492, user_id=c081bd38722144749b58054c5cb645b2, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:02.577144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:02.707796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1325/2667] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:02 2022] PUT /identity/v3/projects/ad8bb0f301814484a078326bfe41c492/users/c081bd38722144749b58054c5cb645b2/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:02.718430 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4452e-cac3-462d-ba14-80ef8d3d5d61 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.718717 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4452e-cac3-462d-ba14-80ef8d3d5d61 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.718993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4452e-cac3-462d-ba14-80ef8d3d5d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.746989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-02b4452e-cac3-462d-ba14-80ef8d3d5d61 None None] MFA Rules not processed for user `c081bd38722144749b58054c5cb645b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:02.748881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-02b4452e-cac3-462d-ba14-80ef8d3d5d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:02.819692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1343/2668] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:02.831359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:02.833127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:02.891427 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9765aa-e0e3-427b-b2cf-794b56101e83 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:02.895084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756b4b-41c5-42b7-b7ab-4c0bafb5903d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:02.897452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756b4b-41c5-42b7-b7ab-4c0bafb5903d service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:02.897452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756b4b-41c5-42b7-b7ab-4c0bafb5903d service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:02.897452 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756b4b-41c5-42b7-b7ab-4c0bafb5903d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:02.904793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756b4b-41c5-42b7-b7ab-4c0bafb5903d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:02.906205 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756b4b-41c5-42b7-b7ab-4c0bafb5903d service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:02.915049 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1326/2669] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:12.816453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:12.911004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:15.740663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4452e-cac3-462d-ba14-80ef8d3d5d61 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:15.742117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-02b4452e-cac3-462d-ba14-80ef8d3d5d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:15.834426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4452e-cac3-462d-ba14-80ef8d3d5d61 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:15.839084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:15.839727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:15.840014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:15.840297 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] PATH_INFO: `/v3/users/f68c018ac43b4b4fbfb2ef3e9e914a95` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:15.841488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68c018ac43b4b4fbfb2ef3e9e914a95)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:15.843947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:16.045834 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68c018ac43b4b4fbfb2ef3e9e914a95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:16.061486 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68c018ac43b4b4fbfb2ef3e9e914a95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:16.071156 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68c018ac43b4b4fbfb2ef3e9e914a95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:16.130286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68c018ac43b4b4fbfb2ef3e9e914a95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:16.134599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68c018ac43b4b4fbfb2ef3e9e914a95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:16.137673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1344/2670] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:15 2022] DELETE /identity/v3/users/f68c018ac43b4b4fbfb2ef3e9e914a95 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:16.142831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858db1a-7f18-405c-9459-caff2004903f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:16.143648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858db1a-7f18-405c-9459-caff2004903f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:16.143926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858db1a-7f18-405c-9459-caff2004903f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:16.162894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f858db1a-7f18-405c-9459-caff2004903f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:16.164081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f858db1a-7f18-405c-9459-caff2004903f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:16.226710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1327/2671] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:16.237317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:16.238832 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:16.309956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e204-c052-4dc4-a6d1-b025725f42d9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:16.314715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127a12f-ba85-4e2d-b5eb-972dda11a5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:16.315327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a12f-ba85-4e2d-b5eb-972dda11a5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:16.315615 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a12f-ba85-4e2d-b5eb-972dda11a5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:16.316007 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a12f-ba85-4e2d-b5eb-972dda11a5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:16.326382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127a12f-ba85-4e2d-b5eb-972dda11a5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:16.327895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127a12f-ba85-4e2d-b5eb-972dda11a5d3 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:16.341221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1345/2672] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:16.760732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858db1a-7f18-405c-9459-caff2004903f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:16.762245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f858db1a-7f18-405c-9459-caff2004903f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:16.776822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858db1a-7f18-405c-9459-caff2004903f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:16.782256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:16.782906 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:16.783891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:16.784172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] PATH_INFO: `/v3/projects/80fe69dc238e422c83dd0e748e4cf023` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:16.785622 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fe69dc238e422c83dd0e748e4cf023)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:16.787585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:16.911889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fe69dc238e422c83dd0e748e4cf023', 'request_id': 'req-640afb65-77d5-422d-aed2-c5273ef9e957'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:17.004524 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fe69dc238e422c83dd0e748e4cf023', 'request_id': 'req-640afb65-77d5-422d-aed2-c5273ef9e957'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:17.015905 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fe69dc238e422c83dd0e748e4cf023', 'request_id': 'req-640afb65-77d5-422d-aed2-c5273ef9e957'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:17.022875 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] The token cache is being invalidate because project 80fe69dc238e422c83dd0e748e4cf023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:17.023167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:17.023794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-640afb65-77d5-422d-aed2-c5273ef9e957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:17.025322 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1328/2673] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:16 2022] DELETE /identity/v3/projects/80fe69dc238e422c83dd0e748e4cf023 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:17.030148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c56a-225c-49d3-aa97-af4a30a36e12 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.030636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c56a-225c-49d3-aa97-af4a30a36e12 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.030764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c56a-225c-49d3-aa97-af4a30a36e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.050653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3015c56a-225c-49d3-aa97-af4a30a36e12 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:17.051849 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3015c56a-225c-49d3-aa97-af4a30a36e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:17.056084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:17.110884 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1346/2674] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:17.118462 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83bc94-5a50-4adf-aa33-21fb761c3930 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.124406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83bc94-5a50-4adf-aa33-21fb761c3930 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.124406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83bc94-5a50-4adf-aa33-21fb761c3930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.138956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0c83bc94-5a50-4adf-aa33-21fb761c3930 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:17.140795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c83bc94-5a50-4adf-aa33-21fb761c3930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:17.148805 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1329/2675] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:17.153270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015c56a-225c-49d3-aa97-af4a30a36e12 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:17.163587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015c56a-225c-49d3-aa97-af4a30a36e12 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:17.168131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:17.168818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.169105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.169380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.170026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:47:17.170333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:17.172600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:17.183981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1347/2676] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:47:17.188995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83bc94-5a50-4adf-aa33-21fb761c3930 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:17.198208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83bc94-5a50-4adf-aa33-21fb761c3930 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:17.202904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc965-d4cc-4c8d-828d-551f71922f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:17.203547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc965-d4cc-4c8d-828d-551f71922f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.203910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc965-d4cc-4c8d-828d-551f71922f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.204187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc965-d4cc-4c8d-828d-551f71922f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.204860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fc965-d4cc-4c8d-828d-551f71922f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:17.206739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fc965-d4cc-4c8d-828d-551f71922f22 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:17.350278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1330/2677] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:17 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:17.355707 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:17.366968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e6dc9-c5c7-4194-bc92-03c8a88981b0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:17.436532 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d0b3-16fe-43df-affa-8052f1cdb168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:17.437412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d0b3-16fe-43df-affa-8052f1cdb168 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.437706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d0b3-16fe-43df-affa-8052f1cdb168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.437989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90d0b3-16fe-43df-affa-8052f1cdb168 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.438657 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90d0b3-16fe-43df-affa-8052f1cdb168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:17.440601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90d0b3-16fe-43df-affa-8052f1cdb168 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:17.524654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1348/2678] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:17 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:47:17.528904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc965-d4cc-4c8d-828d-551f71922f22 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:17.539749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc965-d4cc-4c8d-828d-551f71922f22 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:17.544263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41635195-14cd-45ca-a338-b0a6c5a8dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:17.544900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635195-14cd-45ca-a338-b0a6c5a8dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.545187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635195-14cd-45ca-a338-b0a6c5a8dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.545459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635195-14cd-45ca-a338-b0a6c5a8dfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.546206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41635195-14cd-45ca-a338-b0a6c5a8dfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:17.548511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41635195-14cd-45ca-a338-b0a6c5a8dfbf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:17.558348 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1331/2679] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:17.562405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d0b3-16fe-43df-affa-8052f1cdb168 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:17.572557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90d0b3-16fe-43df-affa-8052f1cdb168 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:17.577265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610d5c2-4570-416c-9ca0-c396666e107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:17.577885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610d5c2-4570-416c-9ca0-c396666e107e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.578176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610d5c2-4570-416c-9ca0-c396666e107e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.578461 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610d5c2-4570-416c-9ca0-c396666e107e admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.579118 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610d5c2-4570-416c-9ca0-c396666e107e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:17.580756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610d5c2-4570-416c-9ca0-c396666e107e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:17.591845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1349/2680] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:47:17.596931 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41635195-14cd-45ca-a338-b0a6c5a8dfbf admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:17.607294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41635195-14cd-45ca-a338-b0a6c5a8dfbf admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:17.612860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:17.613521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.613807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.614141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] PATH_INFO: `/v3/projects/d46f08e4e89a4f6f88e82cfad5513aa5/users/ae03e09576e44166a392b0965bc5be79/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.635741 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46f08e4e89a4f6f88e82cfad5513aa5, user_id=ae03e09576e44166a392b0965bc5be79, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:17.638463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:17.707732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1332/2681] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:17 2022] PUT /identity/v3/projects/d46f08e4e89a4f6f88e82cfad5513aa5/users/ae03e09576e44166a392b0965bc5be79/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:17.719703 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24571c-4eef-4440-8c11-1e53b39314db None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.719984 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24571c-4eef-4440-8c11-1e53b39314db None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.720257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24571c-4eef-4440-8c11-1e53b39314db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.748311 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-be24571c-4eef-4440-8c11-1e53b39314db None None] MFA Rules not processed for user `ae03e09576e44166a392b0965bc5be79`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:17.749547 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-be24571c-4eef-4440-8c11-1e53b39314db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:17.822331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1350/2682] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:17.833939 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:17.835869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:17.867248 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:17.911243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963b1da-8ca8-4c21-89d5-6a347f90185a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:17.916259 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:17.916917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:17.917247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:17.917527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:17.926944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:17.928788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:17.939258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1333/2683] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:22.843754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11171c1-7724-439c-ab09-0fda38026b5f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:22.844271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11171c1-7724-439c-ab09-0fda38026b5f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:22.844403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11171c1-7724-439c-ab09-0fda38026b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:22.852515 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:22.863525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d11171c1-7724-439c-ab09-0fda38026b5f None None] MFA Rules not processed for user `ae03e09576e44166a392b0965bc5be79`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:22.864749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d11171c1-7724-439c-ab09-0fda38026b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:22.876815 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1351/2684] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:23.445977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:23.447480 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:23.523549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb09e5d-295c-4419-9946-5ce1f20b4ca2 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:23.531306 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:23.532790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:23.533148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:23.533876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] PATH_INFO: `/v3/users/6021102abe6e44a0926068595764a489` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:23.535242 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6021102abe6e44a0926068595764a489)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:23.539266 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:23.785006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6021102abe6e44a0926068595764a489'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:23.792288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6021102abe6e44a0926068595764a489'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:23.809218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6021102abe6e44a0926068595764a489'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:23.919013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6021102abe6e44a0926068595764a489'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:23.919747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6021102abe6e44a0926068595764a489'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:23.926640 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1334/2685] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:23 2022] DELETE /identity/v3/users/6021102abe6e44a0926068595764a489 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:23.931261 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150ec1-16f7-4657-ace1-08a10b8cca0c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:23.931735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150ec1-16f7-4657-ace1-08a10b8cca0c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:23.931858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150ec1-16f7-4657-ace1-08a10b8cca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:23.951620 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-21150ec1-16f7-4657-ace1-08a10b8cca0c None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:23.952878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-21150ec1-16f7-4657-ace1-08a10b8cca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:24.012983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1352/2686] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:24.028063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:24.029568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:24.080206 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:24.092230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a27edb-4691-496e-9e66-54b81be709a2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:24.096808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe410e9-5bb1-4ee2-83c8-b7be2f4575d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:24.097416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe410e9-5bb1-4ee2-83c8-b7be2f4575d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:24.097707 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe410e9-5bb1-4ee2-83c8-b7be2f4575d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:24.097975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe410e9-5bb1-4ee2-83c8-b7be2f4575d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:24.107554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe410e9-5bb1-4ee2-83c8-b7be2f4575d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:24.109052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe410e9-5bb1-4ee2-83c8-b7be2f4575d8 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:24.119308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1335/2687] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:24.643822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21150ec1-16f7-4657-ace1-08a10b8cca0c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:24.648243 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-21150ec1-16f7-4657-ace1-08a10b8cca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:24.673713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21150ec1-16f7-4657-ace1-08a10b8cca0c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:24.679148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:24.679787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:24.680066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:24.680338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] PATH_INFO: `/v3/projects/8cdc1aaae02b48cd9876c47172094790` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:24.681493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdc1aaae02b48cd9876c47172094790)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:24.683585 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:24.818325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdc1aaae02b48cd9876c47172094790', 'request_id': 'req-c537bfde-7f86-4a09-8bbc-c822f094d14f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:24.825375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdc1aaae02b48cd9876c47172094790', 'request_id': 'req-c537bfde-7f86-4a09-8bbc-c822f094d14f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:24.832921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdc1aaae02b48cd9876c47172094790', 'request_id': 'req-c537bfde-7f86-4a09-8bbc-c822f094d14f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:24.953763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] The token cache is being invalidate because project 8cdc1aaae02b48cd9876c47172094790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:24.954435 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:24.955141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:24.956754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1353/2688] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:24 2022] DELETE /identity/v3/projects/8cdc1aaae02b48cd9876c47172094790 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:24.960747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe410e9-5bb1-4ee2-83c8-b7be2f4575d8 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:24.971621 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe410e9-5bb1-4ee2-83c8-b7be2f4575d8 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:25.030014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:25.030643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:25.030926 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:25.031200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] PATH_INFO: `/v3/users/16b29cb61f0e4d4799e7eaa4ab0233fa` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:25.032354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b29cb61f0e4d4799e7eaa4ab0233fa)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:25.034310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:25.212281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b29cb61f0e4d4799e7eaa4ab0233fa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:25.227987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b29cb61f0e4d4799e7eaa4ab0233fa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:25.255721 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b29cb61f0e4d4799e7eaa4ab0233fa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:25.331037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b29cb61f0e4d4799e7eaa4ab0233fa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:25.331712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e97e32-543e-4135-9f2c-5ded5f821ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b29cb61f0e4d4799e7eaa4ab0233fa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:25.342568 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1336/2689] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:24 2022] DELETE /identity/v3/users/16b29cb61f0e4d4799e7eaa4ab0233fa => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:25.823258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:25.824960 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:25.845872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537bfde-7f86-4a09-8bbc-c822f094d14f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:25.903937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:25.904604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:25.904890 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:25.905164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] PATH_INFO: `/v3/projects/54d806d1ec284a0eb4527c5f463b10f4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:25.907271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d806d1ec284a0eb4527c5f463b10f4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:25.909656 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:25.935593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:26.019235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d806d1ec284a0eb4527c5f463b10f4', 'request_id': 'req-ee0b9fc1-0573-462f-b922-501328ddd172'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:26.025071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d806d1ec284a0eb4527c5f463b10f4', 'request_id': 'req-ee0b9fc1-0573-462f-b922-501328ddd172'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:26.032313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d806d1ec284a0eb4527c5f463b10f4', 'request_id': 'req-ee0b9fc1-0573-462f-b922-501328ddd172'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:26.108074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] The token cache is being invalidate because project 54d806d1ec284a0eb4527c5f463b10f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:26.108493 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:26.109280 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ee0b9fc1-0573-462f-b922-501328ddd172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:26.112135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1354/2690] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:25 2022] DELETE /identity/v3/projects/54d806d1ec284a0eb4527c5f463b10f4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:26.116821 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60cd85-ebc8-4565-8940-abb694c9f3e1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.117313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60cd85-ebc8-4565-8940-abb694c9f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.117439 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60cd85-ebc8-4565-8940-abb694c9f3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.138782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fb60cd85-ebc8-4565-8940-abb694c9f3e1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:26.140098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fb60cd85-ebc8-4565-8940-abb694c9f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:26.213972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1337/2691] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:26.223034 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f38a-78df-4f12-a6c7-ffcc1106774f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.223593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f38a-78df-4f12-a6c7-ffcc1106774f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.223899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f38a-78df-4f12-a6c7-ffcc1106774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.244713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5d86f38a-78df-4f12-a6c7-ffcc1106774f None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:26.245950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5d86f38a-78df-4f12-a6c7-ffcc1106774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:26.258614 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1355/2692] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:26.259437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60cd85-ebc8-4565-8940-abb694c9f3e1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:26.266301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:26.270268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60cd85-ebc8-4565-8940-abb694c9f3e1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:26.275337 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:26.275937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.276217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.276590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.277245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:47:26.277616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:26.279239 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:26.291788 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1338/2693] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:47:26.300403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86f38a-78df-4f12-a6c7-ffcc1106774f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:26.310199 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86f38a-78df-4f12-a6c7-ffcc1106774f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:26.316147 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c134794-5ceb-4dc0-9488-88fe17787782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:26.316808 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c134794-5ceb-4dc0-9488-88fe17787782 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.317087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c134794-5ceb-4dc0-9488-88fe17787782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.317360 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c134794-5ceb-4dc0-9488-88fe17787782 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.317986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c134794-5ceb-4dc0-9488-88fe17787782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:26.319882 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c134794-5ceb-4dc0-9488-88fe17787782 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:26.401478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1356/2694] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:26 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:26.403245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:26.416608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519bf5-f851-4bc9-be0c-69b06d5bc4c2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:26.476108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ff576-23e9-47c2-8fd4-35c78ac9a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:26.478040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ff576-23e9-47c2-8fd4-35c78ac9a579 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.478040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ff576-23e9-47c2-8fd4-35c78ac9a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.478040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ff576-23e9-47c2-8fd4-35c78ac9a579 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.478040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ff576-23e9-47c2-8fd4-35c78ac9a579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:26.479822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ff576-23e9-47c2-8fd4-35c78ac9a579 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:26.554285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1339/2695] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:26 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:26.558498 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c134794-5ceb-4dc0-9488-88fe17787782 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:26.570535 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c134794-5ceb-4dc0-9488-88fe17787782 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:26.575358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c36b54-afac-4a87-ac4e-4ca22ee4e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:26.576109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c36b54-afac-4a87-ac4e-4ca22ee4e9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.576394 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c36b54-afac-4a87-ac4e-4ca22ee4e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.576704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c36b54-afac-4a87-ac4e-4ca22ee4e9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.577408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c36b54-afac-4a87-ac4e-4ca22ee4e9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:26.580104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c36b54-afac-4a87-ac4e-4ca22ee4e9a0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:26.591022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1357/2696] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:47:26.600966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ff576-23e9-47c2-8fd4-35c78ac9a579 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:26.613400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ff576-23e9-47c2-8fd4-35c78ac9a579 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:26.618807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a40a93-63af-4a6b-9afb-86273a9cab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:26.619738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40a93-63af-4a6b-9afb-86273a9cab5f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.620159 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40a93-63af-4a6b-9afb-86273a9cab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.620453 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a40a93-63af-4a6b-9afb-86273a9cab5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.621576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a40a93-63af-4a6b-9afb-86273a9cab5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:26.623372 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a40a93-63af-4a6b-9afb-86273a9cab5f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:26.636704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1340/2697] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:26.641852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c36b54-afac-4a87-ac4e-4ca22ee4e9a0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:26.652721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c36b54-afac-4a87-ac4e-4ca22ee4e9a0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:26.657804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049322a-9792-4a30-9778-c005e13f99b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:26.658463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049322a-9792-4a30-9778-c005e13f99b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.658741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049322a-9792-4a30-9778-c005e13f99b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.659017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049322a-9792-4a30-9778-c005e13f99b7 admin admin] PATH_INFO: `/v3/projects/07b1cd4d5f5a407ca8b194c3f7ed16f9/users/65d5f4328c2b4f1cb7d20789af60d4c6/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.676937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049322a-9792-4a30-9778-c005e13f99b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b1cd4d5f5a407ca8b194c3f7ed16f9, user_id=65d5f4328c2b4f1cb7d20789af60d4c6, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:26.686387 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049322a-9792-4a30-9778-c005e13f99b7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:26.768672 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1358/2698] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:26 2022] PUT /identity/v3/projects/07b1cd4d5f5a407ca8b194c3f7ed16f9/users/65d5f4328c2b4f1cb7d20789af60d4c6/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:26.780198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8d66-152a-4d16-8606-66d6e452bc02 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.780198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8d66-152a-4d16-8606-66d6e452bc02 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.780583 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8d66-152a-4d16-8606-66d6e452bc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.817544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b26b8d66-152a-4d16-8606-66d6e452bc02 None None] MFA Rules not processed for user `65d5f4328c2b4f1cb7d20789af60d4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:26.819203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b26b8d66-152a-4d16-8606-66d6e452bc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:26.890392 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1341/2699] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:26.895158 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049322a-9792-4a30-9778-c005e13f99b7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:26.961795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049322a-9792-4a30-9778-c005e13f99b7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:26.966959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86ea7c-2ab8-499f-8bac-11ba74688c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:26.969772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86ea7c-2ab8-499f-8bac-11ba74688c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:26.969772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86ea7c-2ab8-499f-8bac-11ba74688c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:26.969772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86ea7c-2ab8-499f-8bac-11ba74688c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:26.969772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86ea7c-2ab8-499f-8bac-11ba74688c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:26.971107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86ea7c-2ab8-499f-8bac-11ba74688c85 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:27.081637 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1359/2700] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:26 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:47:27.085884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8d66-152a-4d16-8606-66d6e452bc02 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:27.097668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8d66-152a-4d16-8606-66d6e452bc02 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:27.175151 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca386a-74ee-43df-a92f-28477ae94efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:27.175900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca386a-74ee-43df-a92f-28477ae94efc admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:27.176052 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca386a-74ee-43df-a92f-28477ae94efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:27.176327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca386a-74ee-43df-a92f-28477ae94efc admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:27.177007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca386a-74ee-43df-a92f-28477ae94efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:27.178951 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca386a-74ee-43df-a92f-28477ae94efc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:27.187639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:27.282382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1342/2701] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:27 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:47:27.285494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86ea7c-2ab8-499f-8bac-11ba74688c85 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:27.297971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86ea7c-2ab8-499f-8bac-11ba74688c85 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:27.303477 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132bab-c81d-4aae-96ee-d103f4e8e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:27.304183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132bab-c81d-4aae-96ee-d103f4e8e388 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:27.304468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132bab-c81d-4aae-96ee-d103f4e8e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:27.304783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132bab-c81d-4aae-96ee-d103f4e8e388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:27.305437 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132bab-c81d-4aae-96ee-d103f4e8e388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:27.307227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132bab-c81d-4aae-96ee-d103f4e8e388 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:27.319008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1360/2702] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:27.322900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca386a-74ee-43df-a92f-28477ae94efc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:27.333332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca386a-74ee-43df-a92f-28477ae94efc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:27.338300 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888de2f-c660-4b28-afdb-5bc7fc8022b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:27.339105 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888de2f-c660-4b28-afdb-5bc7fc8022b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:27.339783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888de2f-c660-4b28-afdb-5bc7fc8022b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:27.339783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888de2f-c660-4b28-afdb-5bc7fc8022b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:27.340270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888de2f-c660-4b28-afdb-5bc7fc8022b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:27.341911 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888de2f-c660-4b28-afdb-5bc7fc8022b9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:27.354629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1343/2703] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:27.358825 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132bab-c81d-4aae-96ee-d103f4e8e388 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:27.369472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132bab-c81d-4aae-96ee-d103f4e8e388 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:27.375651 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bff2f-7f4f-4ff1-ba99-79cefc62355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:27.376317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bff2f-7f4f-4ff1-ba99-79cefc62355e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:27.376634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bff2f-7f4f-4ff1-ba99-79cefc62355e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:27.376908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bff2f-7f4f-4ff1-ba99-79cefc62355e admin admin] PATH_INFO: `/v3/projects/2ffc4838bff94507ab166aeb421c74b2/users/5171020685804c66baca5c5f55daed96/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:27.397196 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bff2f-7f4f-4ff1-ba99-79cefc62355e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffc4838bff94507ab166aeb421c74b2, user_id=5171020685804c66baca5c5f55daed96, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:27.400228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bff2f-7f4f-4ff1-ba99-79cefc62355e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:27.479921 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:27.486031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1361/2704] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:27 2022] PUT /identity/v3/projects/2ffc4838bff94507ab166aeb421c74b2/users/5171020685804c66baca5c5f55daed96/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:27.497551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268f462-9f06-40d9-bf9e-fe7d6ac74573 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:27.497885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268f462-9f06-40d9-bf9e-fe7d6ac74573 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:27.498520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268f462-9f06-40d9-bf9e-fe7d6ac74573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:27.528437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4268f462-9f06-40d9-bf9e-fe7d6ac74573 None None] MFA Rules not processed for user `5171020685804c66baca5c5f55daed96`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:27.530573 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4268f462-9f06-40d9-bf9e-fe7d6ac74573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:27.618158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1344/2705] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:27.622918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bff2f-7f4f-4ff1-ba99-79cefc62355e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:27.691783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bff2f-7f4f-4ff1-ba99-79cefc62355e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:27.696545 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f35f-5cb1-436c-83dd-1590a0dfc8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:27.697170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f35f-5cb1-436c-83dd-1590a0dfc8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:27.697454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f35f-5cb1-436c-83dd-1590a0dfc8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:27.697732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f35f-5cb1-436c-83dd-1590a0dfc8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:27.698371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f35f-5cb1-436c-83dd-1590a0dfc8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:27.700349 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f35f-5cb1-436c-83dd-1590a0dfc8e3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:27.789510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1362/2706] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:27 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:27.793728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268f462-9f06-40d9-bf9e-fe7d6ac74573 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:27.808615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268f462-9f06-40d9-bf9e-fe7d6ac74573 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:27.873807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7f59b-3068-494b-adef-5d1f9f0c28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:27.874421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7f59b-3068-494b-adef-5d1f9f0c28a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:27.874764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7f59b-3068-494b-adef-5d1f9f0c28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:27.875181 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7f59b-3068-494b-adef-5d1f9f0c28a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:27.875633 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7f59b-3068-494b-adef-5d1f9f0c28a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:27.877826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7f59b-3068-494b-adef-5d1f9f0c28a9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:27.957172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1345/2707] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:27 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:27.961402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f35f-5cb1-436c-83dd-1590a0dfc8e3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:27.975331 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f35f-5cb1-436c-83dd-1590a0dfc8e3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:27.980333 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaeac09-40aa-437b-bce2-64e53037dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:27.980963 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeac09-40aa-437b-bce2-64e53037dfdb admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:27.986795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeac09-40aa-437b-bce2-64e53037dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:27.986795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeac09-40aa-437b-bce2-64e53037dfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:27.986795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaeac09-40aa-437b-bce2-64e53037dfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:27.986795 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaeac09-40aa-437b-bce2-64e53037dfdb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:27.996714 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1363/2708] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:47:28.001509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7f59b-3068-494b-adef-5d1f9f0c28a9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:28.016189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7f59b-3068-494b-adef-5d1f9f0c28a9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:28.017922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49d34f-f98c-4355-b49d-fe5762ddc3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:28.018673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d34f-f98c-4355-b49d-fe5762ddc3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:28.018958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d34f-f98c-4355-b49d-fe5762ddc3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:28.019245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d34f-f98c-4355-b49d-fe5762ddc3c9 admin admin] PATH_INFO: `/v3/projects/06171c6fa35446ed9ff0015c8f964218/users/e26ed35e7fc84e828f248d3688a5cf79/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:28.036383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d34f-f98c-4355-b49d-fe5762ddc3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06171c6fa35446ed9ff0015c8f964218, user_id=e26ed35e7fc84e828f248d3688a5cf79, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:28.040978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d34f-f98c-4355-b49d-fe5762ddc3c9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:28.108744 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1346/2709] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:28 2022] PUT /identity/v3/projects/06171c6fa35446ed9ff0015c8f964218/users/e26ed35e7fc84e828f248d3688a5cf79/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:28.112919 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaeac09-40aa-437b-bce2-64e53037dfdb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:28.124080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaeac09-40aa-437b-bce2-64e53037dfdb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:28.183310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97480724-13b8-44ff-87f1-cbd259d2adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:28.183951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97480724-13b8-44ff-87f1-cbd259d2adab admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:28.184231 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97480724-13b8-44ff-87f1-cbd259d2adab admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:28.184533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97480724-13b8-44ff-87f1-cbd259d2adab admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:28.185209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97480724-13b8-44ff-87f1-cbd259d2adab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:28.186842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97480724-13b8-44ff-87f1-cbd259d2adab admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:28.198357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1364/2710] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:28.202693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49d34f-f98c-4355-b49d-fe5762ddc3c9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:28.214188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49d34f-f98c-4355-b49d-fe5762ddc3c9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:28.219134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:28.219801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:28.220078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:28.220351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] PATH_INFO: `/v3/projects/06171c6fa35446ed9ff0015c8f964218/users/e26ed35e7fc84e828f248d3688a5cf79/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:28.222302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06171c6fa35446ed9ff0015c8f964218, user_id=e26ed35e7fc84e828f248d3688a5cf79, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:28.224956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:28.236912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1347/2711] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:28 2022] PUT /identity/v3/projects/06171c6fa35446ed9ff0015c8f964218/users/e26ed35e7fc84e828f248d3688a5cf79/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:47:28.251146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b928-14cc-4f89-8ad3-262fd88fce7f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:28.251542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b928-14cc-4f89-8ad3-262fd88fce7f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:28.251852 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b928-14cc-4f89-8ad3-262fd88fce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:28.280748 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ddf0b928-14cc-4f89-8ad3-262fd88fce7f None None] MFA Rules not processed for user `e26ed35e7fc84e828f248d3688a5cf79`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:28.282141 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ddf0b928-14cc-4f89-8ad3-262fd88fce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:28.340563 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:28.350405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1365/2712] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:28.361641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:28.363280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:28.388343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:28.434040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b631842-2b51-4a16-9a5c-275b9ee5c49e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:28.438767 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:28.443891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:28.443891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:28.443891 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:28.452061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:28.453560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:28.463869 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1348/2713] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:29.560895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b928-14cc-4f89-8ad3-262fd88fce7f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:29.562828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ddf0b928-14cc-4f89-8ad3-262fd88fce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:29.575110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b928-14cc-4f89-8ad3-262fd88fce7f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:29.579559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0373-3653-48ad-af52-1397d369627f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:29.580172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0373-3653-48ad-af52-1397d369627f service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:29.580453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0373-3653-48ad-af52-1397d369627f service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:29.580967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0373-3653-48ad-af52-1397d369627f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:29.642864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e0373-3653-48ad-af52-1397d369627f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:29.644379 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e0373-3653-48ad-af52-1397d369627f service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:29.653579 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1366/2714] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:37.641464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:37.642894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:37.696207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0373-3653-48ad-af52-1397d369627f service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:37.704908 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0373-3653-48ad-af52-1397d369627f service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:37.708533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805419b-7539-46a2-872b-8835dece8e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:37.709138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805419b-7539-46a2-872b-8835dece8e19 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:37.709421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805419b-7539-46a2-872b-8835dece8e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:37.709695 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805419b-7539-46a2-872b-8835dece8e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:37.710617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51121-7419-451b-a5bc-b41f4bf6b586 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:37.715792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:37.716410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:37.716717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:37.716989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] PATH_INFO: `/v3/users/c081bd38722144749b58054c5cb645b2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:37.718098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c081bd38722144749b58054c5cb645b2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:37.720589 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:37.778328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805419b-7539-46a2-872b-8835dece8e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:37.779780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805419b-7539-46a2-872b-8835dece8e19 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:37.789471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1367/2715] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:37.872586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c081bd38722144749b58054c5cb645b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:37.885029 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c081bd38722144749b58054c5cb645b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:37.901986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c081bd38722144749b58054c5cb645b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:37.976525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c081bd38722144749b58054c5cb645b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:37.977153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c081bd38722144749b58054c5cb645b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:37.983588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1349/2716] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:37 2022] DELETE /identity/v3/users/c081bd38722144749b58054c5cb645b2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:37.988764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e5b2-ac41-4e04-89a7-39d041c51cae None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:37.989052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e5b2-ac41-4e04-89a7-39d041c51cae None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:37.989328 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e5b2-ac41-4e04-89a7-39d041c51cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:38.009737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bbd9e5b2-ac41-4e04-89a7-39d041c51cae None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:38.010951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bbd9e5b2-ac41-4e04-89a7-39d041c51cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:38.073105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1368/2717] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:38.083191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:38.084636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:38.131877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:38.143443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a6a81-5198-4e37-98a0-7e3efe8c3bd0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:38.147124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:38.150816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:38.150816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:38.150816 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:38.158675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:38.160133 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:38.169844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1350/2718] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:38.705178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9e5b2-ac41-4e04-89a7-39d041c51cae None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:38.706946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bbd9e5b2-ac41-4e04-89a7-39d041c51cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:38.721758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9e5b2-ac41-4e04-89a7-39d041c51cae None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:38.745937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:38.746576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:38.746845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:38.747265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] PATH_INFO: `/v3/projects/ad8bb0f301814484a078326bfe41c492` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:38.748980 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8bb0f301814484a078326bfe41c492)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:38.752823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:38.995148 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:39.011327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8bb0f301814484a078326bfe41c492', 'request_id': 'req-e976a6af-8fe0-4367-9388-32cf027d1e25'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:39.017353 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8bb0f301814484a078326bfe41c492', 'request_id': 'req-e976a6af-8fe0-4367-9388-32cf027d1e25'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:39.023716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8bb0f301814484a078326bfe41c492', 'request_id': 'req-e976a6af-8fe0-4367-9388-32cf027d1e25'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:39.113108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] The token cache is being invalidate because project ad8bb0f301814484a078326bfe41c492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:39.113403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:39.114036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e976a6af-8fe0-4367-9388-32cf027d1e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:39.115522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1369/2719] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:38 2022] DELETE /identity/v3/projects/ad8bb0f301814484a078326bfe41c492 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:47:42.034204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:42.035597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:42.048244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119525-091c-423b-a1dc-57c4cc21c4e6 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:42.102265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:42.102881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:42.103156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:42.103424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] PATH_INFO: `/v3/users/65d5f4328c2b4f1cb7d20789af60d4c6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:42.104560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d5f4328c2b4f1cb7d20789af60d4c6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:42.106440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:42.281745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d5f4328c2b4f1cb7d20789af60d4c6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:42.288600 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d5f4328c2b4f1cb7d20789af60d4c6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:42.300814 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d5f4328c2b4f1cb7d20789af60d4c6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:42.393120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d5f4328c2b4f1cb7d20789af60d4c6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:42.393736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d5f4328c2b4f1cb7d20789af60d4c6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:42.399672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1351/2720] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:42 2022] DELETE /identity/v3/users/65d5f4328c2b4f1cb7d20789af60d4c6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:42.404207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502071-6dca-4dd0-9a42-f190ce4dfde8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:42.404715 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502071-6dca-4dd0-9a42-f190ce4dfde8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:42.404822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502071-6dca-4dd0-9a42-f190ce4dfde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:42.423211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-24502071-6dca-4dd0-9a42-f190ce4dfde8 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:42.424417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-24502071-6dca-4dd0-9a42-f190ce4dfde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:42.484230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1370/2721] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:42.494846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:42.496283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:42.555504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18665-ca87-45b4-a10c-6d47b25c08b4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:42.559217 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71dda-de40-4a33-8068-ac832d160d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:42.559854 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71dda-de40-4a33-8068-ac832d160d80 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:42.563402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71dda-de40-4a33-8068-ac832d160d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:42.563402 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71dda-de40-4a33-8068-ac832d160d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:42.570304 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f71dda-de40-4a33-8068-ac832d160d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:42.571713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f71dda-de40-4a33-8068-ac832d160d80 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:42.581717 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1352/2722] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:43.276710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24502071-6dca-4dd0-9a42-f190ce4dfde8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:43.278299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-24502071-6dca-4dd0-9a42-f190ce4dfde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:43.290970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24502071-6dca-4dd0-9a42-f190ce4dfde8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:43.295652 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:43.296303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:43.296813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:43.296948 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] PATH_INFO: `/v3/projects/07b1cd4d5f5a407ca8b194c3f7ed16f9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:43.298041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b1cd4d5f5a407ca8b194c3f7ed16f9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:43.300916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:43.429768 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b1cd4d5f5a407ca8b194c3f7ed16f9', 'request_id': 'req-7377af22-f9fd-4ace-a687-e2bec392a81d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:43.435764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b1cd4d5f5a407ca8b194c3f7ed16f9', 'request_id': 'req-7377af22-f9fd-4ace-a687-e2bec392a81d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:43.442677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b1cd4d5f5a407ca8b194c3f7ed16f9', 'request_id': 'req-7377af22-f9fd-4ace-a687-e2bec392a81d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:43.508228 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] The token cache is being invalidate because project 07b1cd4d5f5a407ca8b194c3f7ed16f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:43.508584 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:43.509215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:43.510698 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1371/2723] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:43 2022] DELETE /identity/v3/projects/07b1cd4d5f5a407ca8b194c3f7ed16f9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:43.514710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71dda-de40-4a33-8068-ac832d160d80 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:43.525687 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71dda-de40-4a33-8068-ac832d160d80 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:43.529868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:43.709481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:43.710167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:43.710448 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:43.710729 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] PATH_INFO: `/v3/users/5171020685804c66baca5c5f55daed96` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:43.711910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5171020685804c66baca5c5f55daed96)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:43.713871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:44.049789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5171020685804c66baca5c5f55daed96'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.049789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5171020685804c66baca5c5f55daed96'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.049789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5171020685804c66baca5c5f55daed96'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.085393 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5171020685804c66baca5c5f55daed96'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.086018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5171020685804c66baca5c5f55daed96'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.092346 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1353/2724] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:43 2022] DELETE /identity/v3/users/5171020685804c66baca5c5f55daed96 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:44.555561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:44.557206 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:44.575895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377af22-f9fd-4ace-a687-e2bec392a81d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:44.611662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:44.634885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:44.635519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:44.635797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:44.636069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] PATH_INFO: `/v3/projects/2ffc4838bff94507ab166aeb421c74b2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:44.637200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffc4838bff94507ab166aeb421c74b2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:44.639097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:44.793285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffc4838bff94507ab166aeb421c74b2', 'request_id': 'req-0c2796fe-e522-425c-954a-ecd721c4860e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.803000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffc4838bff94507ab166aeb421c74b2', 'request_id': 'req-0c2796fe-e522-425c-954a-ecd721c4860e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.811073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffc4838bff94507ab166aeb421c74b2', 'request_id': 'req-0c2796fe-e522-425c-954a-ecd721c4860e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.913858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] The token cache is being invalidate because project 2ffc4838bff94507ab166aeb421c74b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:44.914086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.914687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c2796fe-e522-425c-954a-ecd721c4860e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:44.916152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1372/2725] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:44 2022] DELETE /identity/v3/projects/2ffc4838bff94507ab166aeb421c74b2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:44.920158 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:44.921590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:44.933942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bab210-9f82-4b5e-8ffd-a3f84172818e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:44.990240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:44.990871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:44.991155 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:44.991431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] PATH_INFO: `/v3/users/e26ed35e7fc84e828f248d3688a5cf79` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:44.992657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26ed35e7fc84e828f248d3688a5cf79)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:44.994635 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:45.086636 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:45.208983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26ed35e7fc84e828f248d3688a5cf79'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:45.215783 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26ed35e7fc84e828f248d3688a5cf79'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:45.227739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26ed35e7fc84e828f248d3688a5cf79'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:45.290693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26ed35e7fc84e828f248d3688a5cf79'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:45.291319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26ed35e7fc84e828f248d3688a5cf79'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:45.297737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1354/2726] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:44 2022] DELETE /identity/v3/users/e26ed35e7fc84e828f248d3688a5cf79 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:45.416370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1133bf-deec-4ef1-9547-b6430edaca9b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:45.416690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1133bf-deec-4ef1-9547-b6430edaca9b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:45.416970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1133bf-deec-4ef1-9547-b6430edaca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:45.482193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fc1133bf-deec-4ef1-9547-b6430edaca9b None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:45.483497 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fc1133bf-deec-4ef1-9547-b6430edaca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:45.557362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1373/2727] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:45.601190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:45.602719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:45.695033 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ad32e-1cb4-4deb-b7b3-53d9137ff2e4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:45.700146 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcad22-92d8-4d5e-b9eb-9788897d041c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:45.700776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcad22-92d8-4d5e-b9eb-9788897d041c service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:45.701063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcad22-92d8-4d5e-b9eb-9788897d041c service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:45.701365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcad22-92d8-4d5e-b9eb-9788897d041c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:45.710232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcad22-92d8-4d5e-b9eb-9788897d041c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:45.711804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcad22-92d8-4d5e-b9eb-9788897d041c service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:45.720398 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1355/2728] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:47:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:47:45.728701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1133bf-deec-4ef1-9547-b6430edaca9b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:45.730079 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fc1133bf-deec-4ef1-9547-b6430edaca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:45.776940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:45.811959 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1133bf-deec-4ef1-9547-b6430edaca9b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:45.817232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:45.817862 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:45.818143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:45.818416 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] PATH_INFO: `/v3/projects/06171c6fa35446ed9ff0015c8f964218` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:45.819542 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] RBAC: Authorizing `identity:delete_project(project_id=06171c6fa35446ed9ff0015c8f964218)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:45.821478 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:45.973454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06171c6fa35446ed9ff0015c8f964218', 'request_id': 'req-ce3b60fa-32b1-422e-9df5-0e17e57b322d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:45.979356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06171c6fa35446ed9ff0015c8f964218', 'request_id': 'req-ce3b60fa-32b1-422e-9df5-0e17e57b322d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:45.985530 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06171c6fa35446ed9ff0015c8f964218', 'request_id': 'req-ce3b60fa-32b1-422e-9df5-0e17e57b322d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:46.090856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] The token cache is being invalidate because project 06171c6fa35446ed9ff0015c8f964218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:46.090856 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:46.091443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce3b60fa-32b1-422e-9df5-0e17e57b322d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:46.092972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1374/2729] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:45 2022] DELETE /identity/v3/projects/06171c6fa35446ed9ff0015c8f964218 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:46.099665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aa7ad-79df-4ee2-a7fe-ad54d1df90eb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.100114 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aa7ad-79df-4ee2-a7fe-ad54d1df90eb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.100222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aa7ad-79df-4ee2-a7fe-ad54d1df90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.120828 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b39aa7ad-79df-4ee2-a7fe-ad54d1df90eb None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:46.122022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b39aa7ad-79df-4ee2-a7fe-ad54d1df90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:46.181807 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1356/2730] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:46.191448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4345-8680-42c2-a629-91fcb0c23b37 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.191744 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4345-8680-42c2-a629-91fcb0c23b37 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.192022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4345-8680-42c2-a629-91fcb0c23b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.212889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-14ab4345-8680-42c2-a629-91fcb0c23b37 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:46.214344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-14ab4345-8680-42c2-a629-91fcb0c23b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:46.223244 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1375/2731] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:46.227650 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aa7ad-79df-4ee2-a7fe-ad54d1df90eb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:46.237958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aa7ad-79df-4ee2-a7fe-ad54d1df90eb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:46.242930 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:46.243528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.243832 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.244098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.244769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:47:46.245193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:46.246643 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:46.263898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1357/2732] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:47:46.267062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab4345-8680-42c2-a629-91fcb0c23b37 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:46.275992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab4345-8680-42c2-a629-91fcb0c23b37 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:46.280605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40a073-a4f7-447e-bbad-20beeeca65da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:46.281205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a073-a4f7-447e-bbad-20beeeca65da admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.282085 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a073-a4f7-447e-bbad-20beeeca65da admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.282357 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a073-a4f7-447e-bbad-20beeeca65da admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.282999 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40a073-a4f7-447e-bbad-20beeeca65da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:46.284901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40a073-a4f7-447e-bbad-20beeeca65da admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:46.366931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1376/2733] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:46 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:46.371355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:46.376961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:46.383219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e141b4-25a8-4ca2-9804-1394b04055f4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:46.444166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cbc53-0252-4e05-b175-acd42f19cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:46.445110 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cbc53-0252-4e05-b175-acd42f19cec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.445645 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cbc53-0252-4e05-b175-acd42f19cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.445987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cbc53-0252-4e05-b175-acd42f19cec0 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.447281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cbc53-0252-4e05-b175-acd42f19cec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:46.449207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cbc53-0252-4e05-b175-acd42f19cec0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:46.554984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1358/2734] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:46 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:46.559386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40a073-a4f7-447e-bbad-20beeeca65da admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:46.571809 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40a073-a4f7-447e-bbad-20beeeca65da admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:46.577179 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f2a32-765a-4b1d-b439-3db3e310e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:46.577804 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f2a32-765a-4b1d-b439-3db3e310e678 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.578089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f2a32-765a-4b1d-b439-3db3e310e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.578374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f2a32-765a-4b1d-b439-3db3e310e678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.579197 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f2a32-765a-4b1d-b439-3db3e310e678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:46.581053 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f2a32-765a-4b1d-b439-3db3e310e678 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:46.595973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1377/2735] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:46.599842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cbc53-0252-4e05-b175-acd42f19cec0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:46.611936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cbc53-0252-4e05-b175-acd42f19cec0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:46.616895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b31577-e1bc-4a82-864f-456afb6b3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:46.617506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b31577-e1bc-4a82-864f-456afb6b3d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.617842 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b31577-e1bc-4a82-864f-456afb6b3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.618047 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b31577-e1bc-4a82-864f-456afb6b3d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.618684 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b31577-e1bc-4a82-864f-456afb6b3d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:46.621138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b31577-e1bc-4a82-864f-456afb6b3d72 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:46.621986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbce90-be03-459b-8051-44fb051157dc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.622303 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbce90-be03-459b-8051-44fb051157dc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.622805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbce90-be03-459b-8051-44fb051157dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.636040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1359/2736] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:46.637071 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b31577-e1bc-4a82-864f-456afb6b3d72 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:46.643252 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d2cbce90-be03-459b-8051-44fb051157dc None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:46.644503 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d2cbce90-be03-459b-8051-44fb051157dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:46.646925 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b31577-e1bc-4a82-864f-456afb6b3d72 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:46.651659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f438d-d7f0-4696-b690-9051e7f5128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:46.652296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f438d-d7f0-4696-b690-9051e7f5128e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.657326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f438d-d7f0-4696-b690-9051e7f5128e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.657326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f438d-d7f0-4696-b690-9051e7f5128e admin admin] PATH_INFO: `/v3/projects/821b4535e8294db98930746975134fd1/users/abd22a1d26ed45a3a52c7e11e379bdb2/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.669257 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f438d-d7f0-4696-b690-9051e7f5128e admin admin] RBAC: Authorizing `identity:create_grant(project_id=821b4535e8294db98930746975134fd1, user_id=abd22a1d26ed45a3a52c7e11e379bdb2, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:46.671898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f438d-d7f0-4696-b690-9051e7f5128e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:46.700654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1378/2737] 10.222.0.75 () {58 vars in 967 bytes} [Mon Sep 19 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:47:46.717766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbce90-be03-459b-8051-44fb051157dc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:46.717766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d2cbce90-be03-459b-8051-44fb051157dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:46.746050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:46.771564 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1360/2738] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:46 2022] PUT /identity/v3/projects/821b4535e8294db98930746975134fd1/users/abd22a1d26ed45a3a52c7e11e379bdb2/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:46.784836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be559-33ea-4378-b18e-56916be87a22 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.785129 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be559-33ea-4378-b18e-56916be87a22 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.785408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be559-33ea-4378-b18e-56916be87a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.792792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbce90-be03-459b-8051-44fb051157dc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:46.815026 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-945be559-33ea-4378-b18e-56916be87a22 None None] MFA Rules not processed for user `abd22a1d26ed45a3a52c7e11e379bdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:46.816320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-945be559-33ea-4378-b18e-56916be87a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:46.866760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09301b-cff9-4ecf-849d-903b62a00a9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:46.867376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09301b-cff9-4ecf-849d-903b62a00a9c service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.867670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09301b-cff9-4ecf-849d-903b62a00a9c service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.867949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09301b-cff9-4ecf-849d-903b62a00a9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.885956 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1361/2739] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:46.890426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945be559-33ea-4378-b18e-56916be87a22 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:46.925638 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09301b-cff9-4ecf-849d-903b62a00a9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:46.927237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09301b-cff9-4ecf-849d-903b62a00a9c service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:46.935654 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1379/2740] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:47:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:47:46.938527 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:46.954179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945be559-33ea-4378-b18e-56916be87a22 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:46.964171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192634-85ec-44a6-8b02-70289caa5d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:46.964171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192634-85ec-44a6-8b02-70289caa5d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:46.964171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192634-85ec-44a6-8b02-70289caa5d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:46.964171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192634-85ec-44a6-8b02-70289caa5d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:46.964587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe192634-85ec-44a6-8b02-70289caa5d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:46.964587 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe192634-85ec-44a6-8b02-70289caa5d92 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.059604 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1362/2741] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:46 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:47:47.063951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09301b-cff9-4ecf-849d-903b62a00a9c service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:47.073969 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09301b-cff9-4ecf-849d-903b62a00a9c service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:47.128802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df38a2-3157-48a4-9bc3-fefc7c987b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:47.129426 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df38a2-3157-48a4-9bc3-fefc7c987b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.129701 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df38a2-3157-48a4-9bc3-fefc7c987b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.129968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df38a2-3157-48a4-9bc3-fefc7c987b68 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.130596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df38a2-3157-48a4-9bc3-fefc7c987b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:47.132780 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df38a2-3157-48a4-9bc3-fefc7c987b68 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.195161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:47.200737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1380/2742] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:47 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:47.204940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192634-85ec-44a6-8b02-70289caa5d92 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:47.215653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192634-85ec-44a6-8b02-70289caa5d92 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:47.220653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84bdb-f3b9-48e1-a86b-787caa3aa891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:47.221255 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84bdb-f3b9-48e1-a86b-787caa3aa891 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.221532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84bdb-f3b9-48e1-a86b-787caa3aa891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.221800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84bdb-f3b9-48e1-a86b-787caa3aa891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.222444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a84bdb-f3b9-48e1-a86b-787caa3aa891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:47.224011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a84bdb-f3b9-48e1-a86b-787caa3aa891 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.235172 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1363/2743] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:47.239599 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df38a2-3157-48a4-9bc3-fefc7c987b68 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:47.249636 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df38a2-3157-48a4-9bc3-fefc7c987b68 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:47.255380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd95e5f-bd45-4197-b954-880451f2ab91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:47.256030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95e5f-bd45-4197-b954-880451f2ab91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.256309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95e5f-bd45-4197-b954-880451f2ab91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.256622 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95e5f-bd45-4197-b954-880451f2ab91 admin admin] PATH_INFO: `/v3/projects/3350b680fe4045babbd92be4d19abf4d/users/47467520f3cd46a29a994aba2e5d43bc/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.271421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd95e5f-bd45-4197-b954-880451f2ab91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3350b680fe4045babbd92be4d19abf4d, user_id=47467520f3cd46a29a994aba2e5d43bc, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:47.274077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd95e5f-bd45-4197-b954-880451f2ab91 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.372688 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1381/2744] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:47 2022] PUT /identity/v3/projects/3350b680fe4045babbd92be4d19abf4d/users/47467520f3cd46a29a994aba2e5d43bc/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:47.377799 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84bdb-f3b9-48e1-a86b-787caa3aa891 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:47.392743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84bdb-f3b9-48e1-a86b-787caa3aa891 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:47.457913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9924-9b6e-4d36-817b-ffcdaae9b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:47.458520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9924-9b6e-4d36-817b-ffcdaae9b321 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.458794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9924-9b6e-4d36-817b-ffcdaae9b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.459061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9924-9b6e-4d36-817b-ffcdaae9b321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.459688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e9924-9b6e-4d36-817b-ffcdaae9b321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:47.461297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e9924-9b6e-4d36-817b-ffcdaae9b321 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.471541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1364/2745] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:47.475801 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd95e5f-bd45-4197-b954-880451f2ab91 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:47.486818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd95e5f-bd45-4197-b954-880451f2ab91 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:47.491362 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:47.492014 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.492282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.492583 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] PATH_INFO: `/v3/projects/3350b680fe4045babbd92be4d19abf4d/users/47467520f3cd46a29a994aba2e5d43bc/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.494492 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3350b680fe4045babbd92be4d19abf4d, user_id=47467520f3cd46a29a994aba2e5d43bc, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:47.497143 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.507704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1382/2746] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:47 2022] PUT /identity/v3/projects/3350b680fe4045babbd92be4d19abf4d/users/47467520f3cd46a29a994aba2e5d43bc/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:47.519222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b886-7196-4c20-906e-76bab190f5a4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.519507 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b886-7196-4c20-906e-76bab190f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.519785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b886-7196-4c20-906e-76bab190f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.549674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2da0b886-7196-4c20-906e-76bab190f5a4 None None] MFA Rules not processed for user `47467520f3cd46a29a994aba2e5d43bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:47.556560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2da0b886-7196-4c20-906e-76bab190f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:47.622919 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1365/2747] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:47.634358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:47.636066 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:47.695162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e390063-4565-4a06-9cc1-fa87b566bab7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:47.698796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:47.699403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.699681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.699950 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.702107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ce7e6-fa72-48e2-8925-ab05790c318f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.702391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ce7e6-fa72-48e2-8925-ab05790c318f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.710357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ce7e6-fa72-48e2-8925-ab05790c318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.713934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:47.715449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.723737 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e10ce7e6-fa72-48e2-8925-ab05790c318f None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:47.724966 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e10ce7e6-fa72-48e2-8925-ab05790c318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:47.726202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1383/2748] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:47.768315 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:47.781290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:47.785901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:47.787019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1366/2749] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:47:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:47.803848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ce7e6-fa72-48e2-8925-ab05790c318f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:47.807367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f959b-7d1b-4e1a-b1a8-95c28f8d04e7 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:47.811669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc261760-baee-46de-a874-c8d619a474a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:47.812344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261760-baee-46de-a874-c8d619a474a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.812719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261760-baee-46de-a874-c8d619a474a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.813180 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261760-baee-46de-a874-c8d619a474a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.872026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc261760-baee-46de-a874-c8d619a474a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:47.873410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ce7e6-fa72-48e2-8925-ab05790c318f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:47.873514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc261760-baee-46de-a874-c8d619a474a1 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.878745 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df94060-7a1c-4adf-920d-48f31564bf5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:47.879344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94060-7a1c-4adf-920d-48f31564bf5a service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:47.879625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94060-7a1c-4adf-920d-48f31564bf5a service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:47.879898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94060-7a1c-4adf-920d-48f31564bf5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:47.883184 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1384/2750] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:47:47.888933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df94060-7a1c-4adf-920d-48f31564bf5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:47.890497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df94060-7a1c-4adf-920d-48f31564bf5a service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:47.900085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1367/2751] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:47:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 15:47:48.606729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b2c8-af29-4784-a748-371a527737e2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:48.607017 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b2c8-af29-4784-a748-371a527737e2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:48.607293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b2c8-af29-4784-a748-371a527737e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:48.628371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a333b2c8-af29-4784-a748-371a527737e2 None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:48.629608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a333b2c8-af29-4784-a748-371a527737e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:48.637131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1385/2752] 10.222.0.75 () {58 vars in 967 bytes} [Mon Sep 19 15:47:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:48.650061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df94060-7a1c-4adf-920d-48f31564bf5a service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:48.660776 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df94060-7a1c-4adf-920d-48f31564bf5a service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:48.665822 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99edd1-5d71-42ce-a2c0-b72aeff9524d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:48.666418 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99edd1-5d71-42ce-a2c0-b72aeff9524d service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:48.666699 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99edd1-5d71-42ce-a2c0-b72aeff9524d service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:48.666976 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99edd1-5d71-42ce-a2c0-b72aeff9524d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:48.675904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99edd1-5d71-42ce-a2c0-b72aeff9524d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:48.677495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99edd1-5d71-42ce-a2c0-b72aeff9524d service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:48.685784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1368/2753] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:47:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:47:51.353226 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333b2c8-af29-4784-a748-371a527737e2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:51.354650 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a333b2c8-af29-4784-a748-371a527737e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:51.417301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:51.421067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333b2c8-af29-4784-a748-371a527737e2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:51.426453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:51.427084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:51.427358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:51.427625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] PATH_INFO: `/v3/users/ae03e09576e44166a392b0965bc5be79` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:51.429155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae03e09576e44166a392b0965bc5be79)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:51.431102 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:51.694912 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae03e09576e44166a392b0965bc5be79'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:51.707737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae03e09576e44166a392b0965bc5be79'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:51.714922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae03e09576e44166a392b0965bc5be79'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:51.839408 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae03e09576e44166a392b0965bc5be79'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:51.840043 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae03e09576e44166a392b0965bc5be79'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:51.847710 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1386/2754] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:51 2022] DELETE /identity/v3/users/ae03e09576e44166a392b0965bc5be79 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:51.852204 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151529c-7a60-4952-9116-4d1098b3479e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:51.852683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151529c-7a60-4952-9116-4d1098b3479e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:51.852785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151529c-7a60-4952-9116-4d1098b3479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:51.872385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4151529c-7a60-4952-9116-4d1098b3479e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:51.873610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4151529c-7a60-4952-9116-4d1098b3479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:51.931850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1369/2755] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:51.941936 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:51.943318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:52.003050 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50208f8e-2dcf-4962-9762-d1c4c0c479f8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:52.006597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:52.007463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:52.007749 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:52.008018 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:52.017054 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:52.018587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:52.027841 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1387/2756] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:52.275844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151529c-7a60-4952-9116-4d1098b3479e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:52.277309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4151529c-7a60-4952-9116-4d1098b3479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:52.290070 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151529c-7a60-4952-9116-4d1098b3479e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:52.294873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:52.295566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:52.295850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:52.296124 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] PATH_INFO: `/v3/projects/d46f08e4e89a4f6f88e82cfad5513aa5` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:52.297341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46f08e4e89a4f6f88e82cfad5513aa5)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:52.299493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:52.416311 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'request_id': 'req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:52.474277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'request_id': 'req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:52.476519 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:52.481040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'request_id': 'req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:52.491428 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] The token cache is being invalidate because project d46f08e4e89a4f6f88e82cfad5513aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:52.491719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:52.492363 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5dfb909a-fc12-4adb-9f27-96be1c98d8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:52.493861 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1370/2757] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:52 2022] DELETE /identity/v3/projects/d46f08e4e89a4f6f88e82cfad5513aa5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:53.724112 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:53.725531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:53.737871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4f8a-fce6-489e-a1f8-e47ab6497235 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:53.794152 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:53.794770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:53.795048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:53.795317 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] PATH_INFO: `/v3/users/abd22a1d26ed45a3a52c7e11e379bdb2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:53.796418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd22a1d26ed45a3a52c7e11e379bdb2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:53.798351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:53.819232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:53.956258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd22a1d26ed45a3a52c7e11e379bdb2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:53.968278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd22a1d26ed45a3a52c7e11e379bdb2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:53.975787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd22a1d26ed45a3a52c7e11e379bdb2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:54.027920 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd22a1d26ed45a3a52c7e11e379bdb2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:54.028659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd22a1d26ed45a3a52c7e11e379bdb2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:54.035777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1388/2758] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:53 2022] DELETE /identity/v3/users/abd22a1d26ed45a3a52c7e11e379bdb2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:54.040414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622063-1f53-41a3-87f4-2a9c76a946e6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:54.040881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622063-1f53-41a3-87f4-2a9c76a946e6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:54.040986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622063-1f53-41a3-87f4-2a9c76a946e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:54.060145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-62622063-1f53-41a3-87f4-2a9c76a946e6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:54.061379 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-62622063-1f53-41a3-87f4-2a9c76a946e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:54.118485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1371/2759] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:54.129074 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:54.130481 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:54.186961 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a6eb3-017b-4395-b7d4-f917f57ee733 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:54.191200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01c9b1-88b6-4b9f-bd1a-61b92a3809fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:54.191803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c9b1-88b6-4b9f-bd1a-61b92a3809fc service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:54.192086 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c9b1-88b6-4b9f-bd1a-61b92a3809fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:54.193941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c9b1-88b6-4b9f-bd1a-61b92a3809fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:54.207278 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01c9b1-88b6-4b9f-bd1a-61b92a3809fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:54.207457 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01c9b1-88b6-4b9f-bd1a-61b92a3809fc service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:54.216875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1389/2760] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:54.613084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622063-1f53-41a3-87f4-2a9c76a946e6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:54.614657 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-62622063-1f53-41a3-87f4-2a9c76a946e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:54.629518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622063-1f53-41a3-87f4-2a9c76a946e6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:54.634489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:54.635128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:54.635405 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:54.635676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] PATH_INFO: `/v3/projects/821b4535e8294db98930746975134fd1` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:54.637002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=821b4535e8294db98930746975134fd1)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:54.639746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:54.771613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821b4535e8294db98930746975134fd1', 'request_id': 'req-440befde-9a6b-42fc-ae3d-dee7334baa1e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:54.833693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821b4535e8294db98930746975134fd1', 'request_id': 'req-440befde-9a6b-42fc-ae3d-dee7334baa1e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:54.841298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821b4535e8294db98930746975134fd1', 'request_id': 'req-440befde-9a6b-42fc-ae3d-dee7334baa1e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:54.859884 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] The token cache is being invalidate because project 821b4535e8294db98930746975134fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:54.860175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:54.860889 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:54.863038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1372/2761] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:54 2022] DELETE /identity/v3/projects/821b4535e8294db98930746975134fd1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:54.867436 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01c9b1-88b6-4b9f-bd1a-61b92a3809fc service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:54.880004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01c9b1-88b6-4b9f-bd1a-61b92a3809fc service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:54.940004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:54.940660 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:54.940946 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:54.941211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] PATH_INFO: `/v3/users/47467520f3cd46a29a994aba2e5d43bc` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:54.942314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47467520f3cd46a29a994aba2e5d43bc)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:54.944213 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:55.120193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:55.122488 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47467520f3cd46a29a994aba2e5d43bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.134531 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47467520f3cd46a29a994aba2e5d43bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.141227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47467520f3cd46a29a994aba2e5d43bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.222797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47467520f3cd46a29a994aba2e5d43bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.223507 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-19442246-6269-4cc9-abf0-cc15d9e83a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47467520f3cd46a29a994aba2e5d43bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.229826 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1390/2762] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:47:54 2022] DELETE /identity/v3/users/47467520f3cd46a29a994aba2e5d43bc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:55.630349 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:55.631824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:55.646436 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440befde-9a6b-42fc-ae3d-dee7334baa1e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:55.703751 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:55.704374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:55.704682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:55.704953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] PATH_INFO: `/v3/projects/3350b680fe4045babbd92be4d19abf4d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:55.712691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3350b680fe4045babbd92be4d19abf4d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:55.712691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:55.719478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:55.793812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3350b680fe4045babbd92be4d19abf4d', 'request_id': 'req-834e7363-2a63-4770-8613-8198faa4d698'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.907547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3350b680fe4045babbd92be4d19abf4d', 'request_id': 'req-834e7363-2a63-4770-8613-8198faa4d698'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.914615 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3350b680fe4045babbd92be4d19abf4d', 'request_id': 'req-834e7363-2a63-4770-8613-8198faa4d698'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.925313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] The token cache is being invalidate because project 3350b680fe4045babbd92be4d19abf4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:47:55.925594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.926230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-834e7363-2a63-4770-8613-8198faa4d698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:47:55.927688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1373/2763] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:47:55 2022] DELETE /identity/v3/projects/3350b680fe4045babbd92be4d19abf4d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:55.932754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dcf4f-deae-4a7d-977e-446e44ef5336 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:55.933202 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dcf4f-deae-4a7d-977e-446e44ef5336 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:55.933343 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dcf4f-deae-4a7d-977e-446e44ef5336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:55.953094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-790dcf4f-deae-4a7d-977e-446e44ef5336 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:55.954294 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-790dcf4f-deae-4a7d-977e-446e44ef5336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:56.014582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1391/2764] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:56.023416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca8b1c-2f78-45b8-9f67-64a30dbf1c34 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.023704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca8b1c-2f78-45b8-9f67-64a30dbf1c34 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.023984 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca8b1c-2f78-45b8-9f67-64a30dbf1c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.044241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9fca8b1c-2f78-45b8-9f67-64a30dbf1c34 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:56.045475 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9fca8b1c-2f78-45b8-9f67-64a30dbf1c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:56.053525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1374/2765] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:56.057593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dcf4f-deae-4a7d-977e-446e44ef5336 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:56.066874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dcf4f-deae-4a7d-977e-446e44ef5336 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:56.071285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:56.071872 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.072150 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.072417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.073088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:47:56.073403 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:56.074968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:56.086616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1392/2766] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:47:56.090732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca8b1c-2f78-45b8-9f67-64a30dbf1c34 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:56.100457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca8b1c-2f78-45b8-9f67-64a30dbf1c34 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:56.105073 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c1895-7910-45c8-866a-225a2e81debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:56.105665 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1895-7910-45c8-866a-225a2e81debc admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.105942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1895-7910-45c8-866a-225a2e81debc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.106215 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1895-7910-45c8-866a-225a2e81debc admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.106846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c1895-7910-45c8-866a-225a2e81debc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:56.108742 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c1895-7910-45c8-866a-225a2e81debc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:56.264700 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1375/2767] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:56 2022] POST /identity/v3/projects => generated 401 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:56.269611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:56.279572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1a23-6cf6-441a-ab7e-09bc9a962df7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:56.333805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186945c7-3c06-433d-9b7a-9f838af1068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:56.334398 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186945c7-3c06-433d-9b7a-9f838af1068a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.334675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186945c7-3c06-433d-9b7a-9f838af1068a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.334945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186945c7-3c06-433d-9b7a-9f838af1068a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.335569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186945c7-3c06-433d-9b7a-9f838af1068a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:56.337490 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186945c7-3c06-433d-9b7a-9f838af1068a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:56.416881 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1393/2768] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:56 2022] POST /identity/v3/users => generated 301 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:47:56.421018 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c1895-7910-45c8-866a-225a2e81debc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:56.431369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c1895-7910-45c8-866a-225a2e81debc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:56.435936 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc3d20-3524-415e-8c9f-ac61c37eb877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:56.436549 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3d20-3524-415e-8c9f-ac61c37eb877 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.436829 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3d20-3524-415e-8c9f-ac61c37eb877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.441333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3d20-3524-415e-8c9f-ac61c37eb877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.441333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc3d20-3524-415e-8c9f-ac61c37eb877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:56.441333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc3d20-3524-415e-8c9f-ac61c37eb877 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:56.449714 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1376/2769] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:56.453648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186945c7-3c06-433d-9b7a-9f838af1068a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:56.464443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186945c7-3c06-433d-9b7a-9f838af1068a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:56.469091 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf88563-b2a0-4228-875f-341ae1b86512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:56.469704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf88563-b2a0-4228-875f-341ae1b86512 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.469985 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf88563-b2a0-4228-875f-341ae1b86512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.470258 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf88563-b2a0-4228-875f-341ae1b86512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.470900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf88563-b2a0-4228-875f-341ae1b86512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:56.472655 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf88563-b2a0-4228-875f-341ae1b86512 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:56.483149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1394/2770] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:56.487407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc3d20-3524-415e-8c9f-ac61c37eb877 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:56.497455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc3d20-3524-415e-8c9f-ac61c37eb877 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:56.502014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc19f1-3301-4450-aa62-101a484f583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:56.503188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc19f1-3301-4450-aa62-101a484f583d admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.503447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc19f1-3301-4450-aa62-101a484f583d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.503722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc19f1-3301-4450-aa62-101a484f583d admin admin] PATH_INFO: `/v3/projects/0ac96010f45540e3809cd49bec7a431f/users/76015a6f1a314b498ff8679e78531e83/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.519364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc19f1-3301-4450-aa62-101a484f583d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac96010f45540e3809cd49bec7a431f, user_id=76015a6f1a314b498ff8679e78531e83, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:56.523672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc19f1-3301-4450-aa62-101a484f583d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:56.629576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1377/2771] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:56 2022] PUT /identity/v3/projects/0ac96010f45540e3809cd49bec7a431f/users/76015a6f1a314b498ff8679e78531e83/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:56.640249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d77f8-562f-47ea-b154-344b701c4332 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.640565 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d77f8-562f-47ea-b154-344b701c4332 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.640843 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d77f8-562f-47ea-b154-344b701c4332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.668765 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-856d77f8-562f-47ea-b154-344b701c4332 None None] MFA Rules not processed for user `76015a6f1a314b498ff8679e78531e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:56.669898 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-856d77f8-562f-47ea-b154-344b701c4332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:56.682843 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:56.735221 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1395/2772] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:56.740271 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc19f1-3301-4450-aa62-101a484f583d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:56.804953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc19f1-3301-4450-aa62-101a484f583d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:56.809785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a83280-7d0c-44a0-90bf-bac30c7d2de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:56.810391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a83280-7d0c-44a0-90bf-bac30c7d2de1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.810671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a83280-7d0c-44a0-90bf-bac30c7d2de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.810937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a83280-7d0c-44a0-90bf-bac30c7d2de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.811585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a83280-7d0c-44a0-90bf-bac30c7d2de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:56.813582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a83280-7d0c-44a0-90bf-bac30c7d2de1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:56.893042 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1378/2773] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:47:56 2022] POST /identity/v3/projects => generated 401 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:47:56.897704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d77f8-562f-47ea-b154-344b701c4332 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:56.908918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d77f8-562f-47ea-b154-344b701c4332 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:56.965479 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd44c-0823-44ce-8877-e204e1beb0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:56.966094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd44c-0823-44ce-8877-e204e1beb0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:56.966288 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd44c-0823-44ce-8877-e204e1beb0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:56.966562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd44c-0823-44ce-8877-e204e1beb0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:56.967203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd44c-0823-44ce-8877-e204e1beb0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:56.969171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd44c-0823-44ce-8877-e204e1beb0ce admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:57.051253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1396/2774] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:47:56 2022] POST /identity/v3/users => generated 307 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:47:57.055474 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a83280-7d0c-44a0-90bf-bac30c7d2de1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:57.065820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a83280-7d0c-44a0-90bf-bac30c7d2de1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:57.070361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8b054-32ec-48ca-84dc-1f3153fd7c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:57.070953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b054-32ec-48ca-84dc-1f3153fd7c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:57.071228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b054-32ec-48ca-84dc-1f3153fd7c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:57.071496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b054-32ec-48ca-84dc-1f3153fd7c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:57.072118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8b054-32ec-48ca-84dc-1f3153fd7c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:57.073727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8b054-32ec-48ca-84dc-1f3153fd7c57 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:57.083962 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1379/2775] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:57.087914 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd44c-0823-44ce-8877-e204e1beb0ce admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:57.098338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd44c-0823-44ce-8877-e204e1beb0ce admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:57.102893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b55ec-dc19-4e2e-b97e-898e0eefdd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:57.103537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b55ec-dc19-4e2e-b97e-898e0eefdd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:57.103822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b55ec-dc19-4e2e-b97e-898e0eefdd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:57.104099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b55ec-dc19-4e2e-b97e-898e0eefdd41 admin admin] PATH_INFO: `/v3/projects/0224d73dcaaf4ce08e87e8aefadcd703/users/a90002107b1a4f939ed32bfa531a998e/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:57.119155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b55ec-dc19-4e2e-b97e-898e0eefdd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0224d73dcaaf4ce08e87e8aefadcd703, user_id=a90002107b1a4f939ed32bfa531a998e, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:57.121840 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b55ec-dc19-4e2e-b97e-898e0eefdd41 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:57.187555 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1397/2776] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:57 2022] PUT /identity/v3/projects/0224d73dcaaf4ce08e87e8aefadcd703/users/a90002107b1a4f939ed32bfa531a998e/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:57.197316 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8b054-32ec-48ca-84dc-1f3153fd7c57 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:57.207627 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8b054-32ec-48ca-84dc-1f3153fd7c57 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:57.215771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:57.263967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93266-356b-4db2-9bf1-8b442c6942f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:57.264594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93266-356b-4db2-9bf1-8b442c6942f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:57.264880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93266-356b-4db2-9bf1-8b442c6942f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:57.265160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93266-356b-4db2-9bf1-8b442c6942f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:57.265794 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93266-356b-4db2-9bf1-8b442c6942f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:57.267410 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93266-356b-4db2-9bf1-8b442c6942f9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:57.276975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1380/2777] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:47:57.281270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b55ec-dc19-4e2e-b97e-898e0eefdd41 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:57.292691 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b55ec-dc19-4e2e-b97e-898e0eefdd41 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:57.297448 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:57.298101 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:57.298386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:57.298664 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] PATH_INFO: `/v3/projects/0224d73dcaaf4ce08e87e8aefadcd703/users/a90002107b1a4f939ed32bfa531a998e/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:57.301323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0224d73dcaaf4ce08e87e8aefadcd703, user_id=a90002107b1a4f939ed32bfa531a998e, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:57.304052 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:57.314323 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1398/2778] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:47:57 2022] PUT /identity/v3/projects/0224d73dcaaf4ce08e87e8aefadcd703/users/a90002107b1a4f939ed32bfa531a998e/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:47:57.382099 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cec17-bf6a-47ac-b5c7-2320adcf8892 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:57.382642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cec17-bf6a-47ac-b5c7-2320adcf8892 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:57.382917 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cec17-bf6a-47ac-b5c7-2320adcf8892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:57.411898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f40cec17-bf6a-47ac-b5c7-2320adcf8892 None None] MFA Rules not processed for user `a90002107b1a4f939ed32bfa531a998e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:47:57.416288 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f40cec17-bf6a-47ac-b5c7-2320adcf8892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:57.480227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1381/2779] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:47:57 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:47:57.491044 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:57.492814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:47:57.550900 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63debbc-3b6e-4cf9-9abe-7d8c7e675975 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:57.554613 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefcea4-0cc0-470f-bcb7-11eb1974d5b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:57.555217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcea4-0cc0-470f-bcb7-11eb1974d5b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:57.555500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcea4-0cc0-470f-bcb7-11eb1974d5b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:57.555772 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcea4-0cc0-470f-bcb7-11eb1974d5b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:57.564822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefcea4-0cc0-470f-bcb7-11eb1974d5b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:57.566635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefcea4-0cc0-470f-bcb7-11eb1974d5b0 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:57.576249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1399/2780] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:47:57.797326 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cec17-bf6a-47ac-b5c7-2320adcf8892 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:47:57.807041 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cec17-bf6a-47ac-b5c7-2320adcf8892 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:47:57.810720 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50837e8-5830-4c28-859b-67ab984494dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:47:57.811319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50837e8-5830-4c28-859b-67ab984494dc service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:47:57.811597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50837e8-5830-4c28-859b-67ab984494dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:47:57.811873 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50837e8-5830-4c28-859b-67ab984494dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:47:57.868153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50837e8-5830-4c28-859b-67ab984494dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:47:57.869602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50837e8-5830-4c28-859b-67ab984494dc service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:47:57.878883 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1382/2781] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:47:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:48:03.940431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefcea4-0cc0-470f-bcb7-11eb1974d5b0 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:03.953117 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:04.005562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefcea4-0cc0-470f-bcb7-11eb1974d5b0 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:04.010382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:04.011006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:04.011293 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:04.011571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] PATH_INFO: `/v3/users/76015a6f1a314b498ff8679e78531e83` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:04.012736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=76015a6f1a314b498ff8679e78531e83)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:04.014658 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:04.145320 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76015a6f1a314b498ff8679e78531e83'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.157318 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76015a6f1a314b498ff8679e78531e83'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.165083 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76015a6f1a314b498ff8679e78531e83'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.234168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76015a6f1a314b498ff8679e78531e83'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.234798 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76015a6f1a314b498ff8679e78531e83'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.240796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1400/2782] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:48:03 2022] DELETE /identity/v3/users/76015a6f1a314b498ff8679e78531e83 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:48:04.245537 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd7efe-7d88-4659-b4d9-4cbf1bef1b58 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:04.245995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd7efe-7d88-4659-b4d9-4cbf1bef1b58 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:04.246118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd7efe-7d88-4659-b4d9-4cbf1bef1b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:04.265261 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e8cd7efe-7d88-4659-b4d9-4cbf1bef1b58 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:04.266455 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e8cd7efe-7d88-4659-b4d9-4cbf1bef1b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:04.292894 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:04.325403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1383/2783] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:04.335955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:04.337449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:04.392632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e67f37-9217-451a-9074-626a0f29c9bd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:04.396821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e48c-3609-4959-8508-9179b2a7c594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:04.397358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e48c-3609-4959-8508-9179b2a7c594 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:04.397635 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e48c-3609-4959-8508-9179b2a7c594 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:04.397904 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e48c-3609-4959-8508-9179b2a7c594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:04.406590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237e48c-3609-4959-8508-9179b2a7c594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:04.408001 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237e48c-3609-4959-8508-9179b2a7c594 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:04.417878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1401/2784] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:48:04.812535 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd7efe-7d88-4659-b4d9-4cbf1bef1b58 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:04.813985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e8cd7efe-7d88-4659-b4d9-4cbf1bef1b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:04.826591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd7efe-7d88-4659-b4d9-4cbf1bef1b58 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:04.831366 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:04.832616 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:04.832920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:04.833198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] PATH_INFO: `/v3/projects/0ac96010f45540e3809cd49bec7a431f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:04.834336 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac96010f45540e3809cd49bec7a431f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:04.836232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:04.921231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac96010f45540e3809cd49bec7a431f', 'request_id': 'req-7733bf26-f30f-42f9-934c-f46e1d8503f3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.965272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac96010f45540e3809cd49bec7a431f', 'request_id': 'req-7733bf26-f30f-42f9-934c-f46e1d8503f3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.971617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac96010f45540e3809cd49bec7a431f', 'request_id': 'req-7733bf26-f30f-42f9-934c-f46e1d8503f3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.982019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] The token cache is being invalidate because project 0ac96010f45540e3809cd49bec7a431f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:48:04.982303 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.982960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:04.984444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1384/2785] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:48:04 2022] DELETE /identity/v3/projects/0ac96010f45540e3809cd49bec7a431f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:48:04.988902 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e48c-3609-4959-8508-9179b2a7c594 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:04.998386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e48c-3609-4959-8508-9179b2a7c594 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:05.029022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:05.055783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:05.056399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:05.056713 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:05.056989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] PATH_INFO: `/v3/users/a90002107b1a4f939ed32bfa531a998e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:05.058107 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90002107b1a4f939ed32bfa531a998e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:05.060055 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:05.207093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90002107b1a4f939ed32bfa531a998e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.218743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90002107b1a4f939ed32bfa531a998e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.226154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90002107b1a4f939ed32bfa531a998e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.268012 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90002107b1a4f939ed32bfa531a998e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.268670 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc5397c5-5ca9-4cb0-acae-5fb4654b5613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90002107b1a4f939ed32bfa531a998e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.274823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1402/2786] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:48:04 2022] DELETE /identity/v3/users/a90002107b1a4f939ed32bfa531a998e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:48:05.698937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:05.700424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:05.716080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733bf26-f30f-42f9-934c-f46e1d8503f3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:05.777795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:05.778501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:05.779189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:05.779189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] PATH_INFO: `/v3/projects/0224d73dcaaf4ce08e87e8aefadcd703` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:05.780153 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0224d73dcaaf4ce08e87e8aefadcd703)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:05.782128 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:05.891558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0224d73dcaaf4ce08e87e8aefadcd703', 'request_id': 'req-df356524-ca4e-4d75-91bb-e986fd3db1a5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.965281 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0224d73dcaaf4ce08e87e8aefadcd703', 'request_id': 'req-df356524-ca4e-4d75-91bb-e986fd3db1a5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.966510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:05.972327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0224d73dcaaf4ce08e87e8aefadcd703', 'request_id': 'req-df356524-ca4e-4d75-91bb-e986fd3db1a5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.983689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] The token cache is being invalidate because project 0224d73dcaaf4ce08e87e8aefadcd703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:48:05.983977 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.984659 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-df356524-ca4e-4d75-91bb-e986fd3db1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:05.986134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1385/2787] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:48:05 2022] DELETE /identity/v3/projects/0224d73dcaaf4ce08e87e8aefadcd703 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:48:05.991463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574daa-140b-4d14-8911-5af9e260b026 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:05.991947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574daa-140b-4d14-8911-5af9e260b026 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:05.992037 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574daa-140b-4d14-8911-5af9e260b026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.016968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e4574daa-140b-4d14-8911-5af9e260b026 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:06.018182 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e4574daa-140b-4d14-8911-5af9e260b026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:06.078222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1403/2788] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:06.086121 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57bbc4-630b-4747-8c22-b61f93ef9c32 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.086411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57bbc4-630b-4747-8c22-b61f93ef9c32 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.086689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57bbc4-630b-4747-8c22-b61f93ef9c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.107050 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4e57bbc4-630b-4747-8c22-b61f93ef9c32 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:06.108265 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4e57bbc4-630b-4747-8c22-b61f93ef9c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:06.116713 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1386/2789] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:06.121166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574daa-140b-4d14-8911-5af9e260b026 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:06.130757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574daa-140b-4d14-8911-5af9e260b026 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:06.135547 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:06.136140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.136422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.136733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.137381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:48:06.137684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:06.139282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:06.150913 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1404/2790] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:48:06.155084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57bbc4-630b-4747-8c22-b61f93ef9c32 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:06.164958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57bbc4-630b-4747-8c22-b61f93ef9c32 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:06.169610 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d61b0-2ea5-459d-9a7d-34e8b76dc950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:06.170203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d61b0-2ea5-459d-9a7d-34e8b76dc950 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.170491 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d61b0-2ea5-459d-9a7d-34e8b76dc950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.170771 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d61b0-2ea5-459d-9a7d-34e8b76dc950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.171400 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d61b0-2ea5-459d-9a7d-34e8b76dc950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:06.173297 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d61b0-2ea5-459d-9a7d-34e8b76dc950 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:06.258758 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1387/2791] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:48:06 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:48:06.262730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:06.272860 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e0980-2ee0-44d3-ae47-03a64044f9b6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:06.310965 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:06.328970 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e45e23-b3b1-41b5-ae48-3a5840f483c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:06.329514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45e23-b3b1-41b5-ae48-3a5840f483c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.329800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45e23-b3b1-41b5-ae48-3a5840f483c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.330067 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45e23-b3b1-41b5-ae48-3a5840f483c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.330708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e45e23-b3b1-41b5-ae48-3a5840f483c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:06.332901 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e45e23-b3b1-41b5-ae48-3a5840f483c6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:06.394424 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1405/2792] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:48:06 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:48:06.399317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d61b0-2ea5-459d-9a7d-34e8b76dc950 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:06.409795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d61b0-2ea5-459d-9a7d-34e8b76dc950 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:06.415396 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec662-fa8b-4cfe-a4c0-3dc6eb564d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:06.415996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec662-fa8b-4cfe-a4c0-3dc6eb564d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.416280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec662-fa8b-4cfe-a4c0-3dc6eb564d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.416599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec662-fa8b-4cfe-a4c0-3dc6eb564d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.417240 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ec662-fa8b-4cfe-a4c0-3dc6eb564d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:06.418820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ec662-fa8b-4cfe-a4c0-3dc6eb564d6a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:06.429092 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1388/2793] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:48:06.438539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e45e23-b3b1-41b5-ae48-3a5840f483c6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:06.448327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e45e23-b3b1-41b5-ae48-3a5840f483c6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:06.452949 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52df39-3873-4961-898b-a244049d5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:06.453544 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52df39-3873-4961-898b-a244049d5d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.453823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52df39-3873-4961-898b-a244049d5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.454094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52df39-3873-4961-898b-a244049d5d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.454731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52df39-3873-4961-898b-a244049d5d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:06.456313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52df39-3873-4961-898b-a244049d5d16 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:06.467751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1406/2794] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:48:06.471514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec662-fa8b-4cfe-a4c0-3dc6eb564d6a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:06.481943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec662-fa8b-4cfe-a4c0-3dc6eb564d6a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:06.486560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:06.487207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.487487 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.487780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] PATH_INFO: `/v3/projects/fc5af3e0c4cc4914a4a92920974de27c/users/4000d5b5c0344058baab36c6fa13e48e/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.502368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5af3e0c4cc4914a4a92920974de27c, user_id=4000d5b5c0344058baab36c6fa13e48e, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:06.505085 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:06.577198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1389/2795] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:48:06 2022] PUT /identity/v3/projects/fc5af3e0c4cc4914a4a92920974de27c/users/4000d5b5c0344058baab36c6fa13e48e/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:48:06.593930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90c1d-4e6e-47b0-8e32-9485f39874d3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.593930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90c1d-4e6e-47b0-8e32-9485f39874d3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.593930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90c1d-4e6e-47b0-8e32-9485f39874d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.616796 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-82b90c1d-4e6e-47b0-8e32-9485f39874d3 None None] MFA Rules not processed for user `4000d5b5c0344058baab36c6fa13e48e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:06.617995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-82b90c1d-4e6e-47b0-8e32-9485f39874d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:06.683735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1407/2796] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:06.694528 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:06.696286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:06.751772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4da3e-73f3-4d39-a58c-eab363e4f856 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:06.756098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5efa9e-bdff-4f31-b7a4-3df573f6a7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:06.756734 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5efa9e-bdff-4f31-b7a4-3df573f6a7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:06.757013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5efa9e-bdff-4f31-b7a4-3df573f6a7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:06.757283 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5efa9e-bdff-4f31-b7a4-3df573f6a7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:06.765975 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5efa9e-bdff-4f31-b7a4-3df573f6a7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:06.767376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5efa9e-bdff-4f31-b7a4-3df573f6a7b3 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:06.776694 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1390/2797] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:48:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:48:16.680936 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:16.772824 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=58,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:18.681930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b90c1d-4e6e-47b0-8e32-9485f39874d3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:18.755606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b90c1d-4e6e-47b0-8e32-9485f39874d3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:18.760321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:18.760981 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:18.761265 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:18.761541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] PATH_INFO: `/v3/users/4000d5b5c0344058baab36c6fa13e48e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:18.762662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4000d5b5c0344058baab36c6fa13e48e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:18.764646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:19.077500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4000d5b5c0344058baab36c6fa13e48e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:19.090719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4000d5b5c0344058baab36c6fa13e48e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:19.098686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4000d5b5c0344058baab36c6fa13e48e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:19.178176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4000d5b5c0344058baab36c6fa13e48e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:19.178805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4000d5b5c0344058baab36c6fa13e48e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:19.185191 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1408/2798] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:48:18 2022] DELETE /identity/v3/users/4000d5b5c0344058baab36c6fa13e48e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:48:19.189848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2446-5a8d-484e-b114-738b9bf5a8bc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:19.190290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2446-5a8d-484e-b114-738b9bf5a8bc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:19.190411 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2446-5a8d-484e-b114-738b9bf5a8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:19.219802 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3c0e2446-5a8d-484e-b114-738b9bf5a8bc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:19.221053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3c0e2446-5a8d-484e-b114-738b9bf5a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:19.278840 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1391/2799] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:19.288533 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:19.289918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:19.360609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2527ef-3fd9-421e-b030-21362b56ae81 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:19.365393 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f01e4-84de-402e-92e8-423a5bd998c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:19.366269 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f01e4-84de-402e-92e8-423a5bd998c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:19.366684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f01e4-84de-402e-92e8-423a5bd998c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:19.367090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f01e4-84de-402e-92e8-423a5bd998c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:19.381704 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f01e4-84de-402e-92e8-423a5bd998c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:19.383163 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f01e4-84de-402e-92e8-423a5bd998c4 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:19.389646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:19.394465 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1409/2800] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:48:19.781355 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e2446-5a8d-484e-b114-738b9bf5a8bc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:19.781675 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3c0e2446-5a8d-484e-b114-738b9bf5a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:19.796965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e2446-5a8d-484e-b114-738b9bf5a8bc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:19.803324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:19.804360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:19.810312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:19.810312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] PATH_INFO: `/v3/projects/fc5af3e0c4cc4914a4a92920974de27c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:19.810312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5af3e0c4cc4914a4a92920974de27c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:19.810312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:19.936793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5af3e0c4cc4914a4a92920974de27c', 'request_id': 'req-5c127b7d-eac0-4c44-9252-5f519d3015cb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:20.027750 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5af3e0c4cc4914a4a92920974de27c', 'request_id': 'req-5c127b7d-eac0-4c44-9252-5f519d3015cb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:20.034294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5af3e0c4cc4914a4a92920974de27c', 'request_id': 'req-5c127b7d-eac0-4c44-9252-5f519d3015cb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:20.045327 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] The token cache is being invalidate because project fc5af3e0c4cc4914a4a92920974de27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:48:20.045617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:20.046256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5c127b7d-eac0-4c44-9252-5f519d3015cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:48:20.047732 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1392/2801] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:48:19 2022] DELETE /identity/v3/projects/fc5af3e0c4cc4914a4a92920974de27c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:48:20.052778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669bf4-e9a3-4503-bd13-5e3e28e03f99 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.053276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669bf4-e9a3-4503-bd13-5e3e28e03f99 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.053375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669bf4-e9a3-4503-bd13-5e3e28e03f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.072778 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6d669bf4-e9a3-4503-bd13-5e3e28e03f99 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:20.073968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6d669bf4-e9a3-4503-bd13-5e3e28e03f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:20.133370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1410/2802] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:20.141459 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92945bb-6446-4f18-b2e5-5a809ece677e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.141743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92945bb-6446-4f18-b2e5-5a809ece677e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.142015 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92945bb-6446-4f18-b2e5-5a809ece677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.162497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b92945bb-6446-4f18-b2e5-5a809ece677e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:20.163702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b92945bb-6446-4f18-b2e5-5a809ece677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:20.171521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1393/2803] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:20.175752 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669bf4-e9a3-4503-bd13-5e3e28e03f99 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:20.185445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669bf4-e9a3-4503-bd13-5e3e28e03f99 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:20.190062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:20.190596 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.190875 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.191149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.192144 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:48:20.192450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:20.194071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:20.205364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1411/2804] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:48:20.210032 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92945bb-6446-4f18-b2e5-5a809ece677e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:20.219011 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92945bb-6446-4f18-b2e5-5a809ece677e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:20.224352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3b98d-fe31-439f-9560-e1b77c24e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:20.224983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b98d-fe31-439f-9560-e1b77c24e00e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.225264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b98d-fe31-439f-9560-e1b77c24e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.225538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b98d-fe31-439f-9560-e1b77c24e00e admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.226175 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3b98d-fe31-439f-9560-e1b77c24e00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:20.228045 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3b98d-fe31-439f-9560-e1b77c24e00e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:20.320949 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1394/2805] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:48:20 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:48:20.325020 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:20.335422 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedb7c7-6b06-463f-9ba1-c258686c18f8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:20.390475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a36b-930f-4f6b-b116-798c51b705a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:20.391077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a36b-930f-4f6b-b116-798c51b705a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.391356 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a36b-930f-4f6b-b116-798c51b705a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.391626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05a36b-930f-4f6b-b116-798c51b705a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.392287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05a36b-930f-4f6b-b116-798c51b705a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:20.394225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05a36b-930f-4f6b-b116-798c51b705a5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:20.503608 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1412/2806] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:48:20 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:48:20.508245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3b98d-fe31-439f-9560-e1b77c24e00e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:20.518755 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3b98d-fe31-439f-9560-e1b77c24e00e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:20.524307 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2576b-8df1-4390-bd04-f29dd0e01bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:20.524941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2576b-8df1-4390-bd04-f29dd0e01bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.525216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2576b-8df1-4390-bd04-f29dd0e01bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.525486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2576b-8df1-4390-bd04-f29dd0e01bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.526145 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2576b-8df1-4390-bd04-f29dd0e01bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:20.527743 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2576b-8df1-4390-bd04-f29dd0e01bfd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:20.538364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1395/2807] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:48:20.542433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a36b-930f-4f6b-b116-798c51b705a5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:20.552455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05a36b-930f-4f6b-b116-798c51b705a5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:20.557189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c936b8-36e4-4ed1-a5e9-5c1721fc49db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:20.557787 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c936b8-36e4-4ed1-a5e9-5c1721fc49db admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.558071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c936b8-36e4-4ed1-a5e9-5c1721fc49db admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.558348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c936b8-36e4-4ed1-a5e9-5c1721fc49db admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.558992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c936b8-36e4-4ed1-a5e9-5c1721fc49db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:20.560624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c936b8-36e4-4ed1-a5e9-5c1721fc49db admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:20.571783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1413/2808] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:48:20.575882 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2576b-8df1-4390-bd04-f29dd0e01bfd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:20.586739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2576b-8df1-4390-bd04-f29dd0e01bfd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:20.591408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:20.592068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.592350 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.592702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] PATH_INFO: `/v3/projects/aa0d850d32ec44a298454aec53c823a5/users/876cbb6dc8d147e78a8205b2eef241a4/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.608069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0d850d32ec44a298454aec53c823a5, user_id=876cbb6dc8d147e78a8205b2eef241a4, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:20.610733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:20.698502 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1396/2809] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:48:20 2022] PUT /identity/v3/projects/aa0d850d32ec44a298454aec53c823a5/users/876cbb6dc8d147e78a8205b2eef241a4/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:48:20.703646 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328d67-9454-4b85-a09a-e5f43a65f573 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.703944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328d67-9454-4b85-a09a-e5f43a65f573 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.704218 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328d67-9454-4b85-a09a-e5f43a65f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.723418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e4328d67-9454-4b85-a09a-e5f43a65f573 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:20.724663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e4328d67-9454-4b85-a09a-e5f43a65f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:20.785463 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1414/2810] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:20.795203 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:20.796945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:20.811369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:20.855613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57929-fee3-4990-828b-84888e0ee34a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:20.859403 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:20.860010 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:20.860293 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:20.860606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:20.870722 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:20.872167 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:20.882187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1397/2811] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:48:22.366406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9dac4-2610-4050-a384-cc2091510a86 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:22.366888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9dac4-2610-4050-a384-cc2091510a86 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:22.366991 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9dac4-2610-4050-a384-cc2091510a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:22.380283 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:22.398942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-18a9dac4-2610-4050-a384-cc2091510a86 None None] MFA Rules not processed for user `876cbb6dc8d147e78a8205b2eef241a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:22.400164 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-18a9dac4-2610-4050-a384-cc2091510a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:22.473753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1415/2812] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:22.483958 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:48:22.485572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:22.544056 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f4823-8d16-4d02-9381-8a1f1680b14f service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:48:22.548412 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ecec4-11f6-494c-bf54-85516520bb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:48:22.552586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ecec4-11f6-494c-bf54-85516520bb80 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:22.552586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ecec4-11f6-494c-bf54-85516520bb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:22.552586 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ecec4-11f6-494c-bf54-85516520bb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:22.558298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ecec4-11f6-494c-bf54-85516520bb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:48:22.559733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ecec4-11f6-494c-bf54-85516520bb80 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:48:22.569273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1398/2813] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:48:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:48:24.186327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dcdb1-0afb-4675-acc2-6e826a78dd4d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:24.186803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dcdb1-0afb-4675-acc2-6e826a78dd4d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:24.186887 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dcdb1-0afb-4675-acc2-6e826a78dd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:24.205943 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a56dcdb1-0afb-4675-acc2-6e826a78dd4d None None] MFA Rules not processed for user `876cbb6dc8d147e78a8205b2eef241a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:24.209125 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a56dcdb1-0afb-4675-acc2-6e826a78dd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:24.214598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1416/2814] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:32.565152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=47 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:34.200519 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=32 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:46.159705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c94f2-f1be-4853-b345-103899fb6954 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:46.160247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c94f2-f1be-4853-b345-103899fb6954 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:46.160332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c94f2-f1be-4853-b345-103899fb6954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:46.183493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ae3c94f2-f1be-4853-b345-103899fb6954 None None] MFA Rules not processed for user `876cbb6dc8d147e78a8205b2eef241a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:46.184763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ae3c94f2-f1be-4853-b345-103899fb6954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:46.192770 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1399/2815] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:48.949383 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77315e-97c6-460e-8e2c-455c86aa7959 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:48:48.949942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77315e-97c6-460e-8e2c-455c86aa7959 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:48:48.949942 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77315e-97c6-460e-8e2c-455c86aa7959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:48:48.976731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5a77315e-97c6-460e-8e2c-455c86aa7959 None None] MFA Rules not processed for user `fb7200a9769b46b3a79c9fe6287a1724`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:48:48.977945 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5a77315e-97c6-460e-8e2c-455c86aa7959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:48:49.048026 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1417/2816] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:48:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:48:56.177560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:59.041151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=25 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:13.916644 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10708c7-3154-4f65-9ec2-828e08b2700d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:13.917082 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10708c7-3154-4f65-9ec2-828e08b2700d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:13.917195 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10708c7-3154-4f65-9ec2-828e08b2700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:13.936868 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c10708c7-3154-4f65-9ec2-828e08b2700d None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:13.938054 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c10708c7-3154-4f65-9ec2-828e08b2700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:13.995809 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1400/2817] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:14.158677 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77315e-97c6-460e-8e2c-455c86aa7959 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:14.159754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5a77315e-97c6-460e-8e2c-455c86aa7959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:14.231971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77315e-97c6-460e-8e2c-455c86aa7959 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:14.237195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b761262-aab1-49cd-912d-858f94af7860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:14.237846 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b761262-aab1-49cd-912d-858f94af7860 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:14.238120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b761262-aab1-49cd-912d-858f94af7860 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:14.238386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b761262-aab1-49cd-912d-858f94af7860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:14.246933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b761262-aab1-49cd-912d-858f94af7860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:14.248505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b761262-aab1-49cd-912d-858f94af7860 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:14.257170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1418/2818] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:49:23.703260 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10708c7-3154-4f65-9ec2-828e08b2700d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:23.704983 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c10708c7-3154-4f65-9ec2-828e08b2700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:23.816963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10708c7-3154-4f65-9ec2-828e08b2700d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:23.823299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:23.823912 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:23.824193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:23.824466 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:23.826374 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:23.841681 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:23.843465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:23.856171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1401/2819] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:49:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:49:24.253241 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=34 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:30.897940 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cb11e-964b-4da8-8512-bec9a054202d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:30.898483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cb11e-964b-4da8-8512-bec9a054202d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:30.898483 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cb11e-964b-4da8-8512-bec9a054202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:30.918013 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3c4cb11e-964b-4da8-8512-bec9a054202d None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:30.919209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3c4cb11e-964b-4da8-8512-bec9a054202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:30.926273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1419/2820] 10.222.0.75 () {58 vars in 967 bytes} [Mon Sep 19 15:49:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:30.939211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:30.950264 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec8b01-f4f8-4c6d-a29a-07ef9a6bdbaa service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:30.955123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c294cb2-9d9e-45b7-9ca2-75e35af72dce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:30.955704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c294cb2-9d9e-45b7-9ca2-75e35af72dce service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:30.955979 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c294cb2-9d9e-45b7-9ca2-75e35af72dce service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:30.956244 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c294cb2-9d9e-45b7-9ca2-75e35af72dce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:30.963971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c294cb2-9d9e-45b7-9ca2-75e35af72dce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:30.965544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c294cb2-9d9e-45b7-9ca2-75e35af72dce service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:30.973551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1402/2821] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:49:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 15:49:33.909800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cb11e-964b-4da8-8512-bec9a054202d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:33.922800 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cb11e-964b-4da8-8512-bec9a054202d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:33.927242 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:33.928537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:33.928821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:33.929094 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] PATH_INFO: `/v3/users/876cbb6dc8d147e78a8205b2eef241a4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:33.930211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] RBAC: Authorizing `identity:delete_user(user_id=876cbb6dc8d147e78a8205b2eef241a4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:33.932132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:34.123986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876cbb6dc8d147e78a8205b2eef241a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.137011 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876cbb6dc8d147e78a8205b2eef241a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.143931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876cbb6dc8d147e78a8205b2eef241a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.219374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876cbb6dc8d147e78a8205b2eef241a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.220009 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58a48135-23b4-4611-ada4-47a19897391a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876cbb6dc8d147e78a8205b2eef241a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.227061 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1420/2822] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:49:33 2022] DELETE /identity/v3/users/876cbb6dc8d147e78a8205b2eef241a4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:49:34.500663 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c294cb2-9d9e-45b7-9ca2-75e35af72dce service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:34.512187 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c294cb2-9d9e-45b7-9ca2-75e35af72dce service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:34.565756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:34.572276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:34.577913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:34.577913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:34.577913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] PATH_INFO: `/v3/projects/aa0d850d32ec44a298454aec53c823a5` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:34.577913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0d850d32ec44a298454aec53c823a5)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:34.577913 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:34.670856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0d850d32ec44a298454aec53c823a5', 'request_id': 'req-6e2e0968-8c13-4da8-82f7-d5fe7542366b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.727432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0d850d32ec44a298454aec53c823a5', 'request_id': 'req-6e2e0968-8c13-4da8-82f7-d5fe7542366b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.733961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0d850d32ec44a298454aec53c823a5', 'request_id': 'req-6e2e0968-8c13-4da8-82f7-d5fe7542366b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.745481 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] The token cache is being invalidate because project aa0d850d32ec44a298454aec53c823a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:49:34.745710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.746345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6e2e0968-8c13-4da8-82f7-d5fe7542366b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:34.748251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1403/2823] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:49:34 2022] DELETE /identity/v3/projects/aa0d850d32ec44a298454aec53c823a5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:49:34.753593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2921-545a-4167-873a-996ace04e8e2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:34.753880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2921-545a-4167-873a-996ace04e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:34.754146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2921-545a-4167-873a-996ace04e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:34.773604 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e5cc2921-545a-4167-873a-996ace04e8e2 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:34.774785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e5cc2921-545a-4167-873a-996ace04e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:34.832763 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1421/2824] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:34.846642 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3c68-379f-4913-a233-50d44694e2de None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:34.846942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3c68-379f-4913-a233-50d44694e2de None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:34.847210 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3c68-379f-4913-a233-50d44694e2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:34.867826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9fae3c68-379f-4913-a233-50d44694e2de None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:34.869053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9fae3c68-379f-4913-a233-50d44694e2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:34.876774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1404/2825] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:34.880994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2921-545a-4167-873a-996ace04e8e2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:34.890792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2921-545a-4167-873a-996ace04e8e2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:34.895270 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:34.895864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:34.896140 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:34.896628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:34.897282 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:49:34.897582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:34.899168 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:34.910412 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1422/2826] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:49:34.915378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3c68-379f-4913-a233-50d44694e2de None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:34.924464 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3c68-379f-4913-a233-50d44694e2de None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:34.929815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6be2a-f6e9-4d50-a2fa-a3f4b05d31b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:34.930407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6be2a-f6e9-4d50-a2fa-a3f4b05d31b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:34.930682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6be2a-f6e9-4d50-a2fa-a3f4b05d31b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:34.930953 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6be2a-f6e9-4d50-a2fa-a3f4b05d31b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:34.931581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6be2a-f6e9-4d50-a2fa-a3f4b05d31b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:34.933488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6be2a-f6e9-4d50-a2fa-a3f4b05d31b9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:35.014775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1405/2827] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:49:34 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:49:35.018996 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:35.029845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed60c6-909f-4a96-ab2e-8ec6b1d14a40 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:35.077537 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:35.086418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99852-2e3f-4f55-955f-9f6e7db92025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:35.087077 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99852-2e3f-4f55-955f-9f6e7db92025 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:35.087361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99852-2e3f-4f55-955f-9f6e7db92025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:35.087639 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99852-2e3f-4f55-955f-9f6e7db92025 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:35.088276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e99852-2e3f-4f55-955f-9f6e7db92025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:35.090321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e99852-2e3f-4f55-955f-9f6e7db92025 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:35.179629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1423/2828] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:49:35 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:49:35.183727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6be2a-f6e9-4d50-a2fa-a3f4b05d31b9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:35.194918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6be2a-f6e9-4d50-a2fa-a3f4b05d31b9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:35.199552 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cce2f-e3a7-4a2e-9e71-c228640b6e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:35.200156 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cce2f-e3a7-4a2e-9e71-c228640b6e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:35.200511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cce2f-e3a7-4a2e-9e71-c228640b6e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:35.200803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cce2f-e3a7-4a2e-9e71-c228640b6e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:35.201447 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cce2f-e3a7-4a2e-9e71-c228640b6e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:35.203014 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cce2f-e3a7-4a2e-9e71-c228640b6e1d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:35.213522 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1406/2829] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:49:35.217616 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99852-2e3f-4f55-955f-9f6e7db92025 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:35.227951 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99852-2e3f-4f55-955f-9f6e7db92025 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:35.232634 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b016c0-73c0-4f6b-8fac-ab4ec94fe5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:35.233230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b016c0-73c0-4f6b-8fac-ab4ec94fe5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:35.233511 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b016c0-73c0-4f6b-8fac-ab4ec94fe5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:35.233786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b016c0-73c0-4f6b-8fac-ab4ec94fe5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:35.234419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b016c0-73c0-4f6b-8fac-ab4ec94fe5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:35.236003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b016c0-73c0-4f6b-8fac-ab4ec94fe5ec admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:35.247711 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1424/2830] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:49:35.251740 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cce2f-e3a7-4a2e-9e71-c228640b6e1d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:35.262955 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cce2f-e3a7-4a2e-9e71-c228640b6e1d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:35.267572 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:35.268160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:35.268441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:35.268748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] PATH_INFO: `/v3/projects/e9604638e96a4b4c88bca16d43088fb4/users/bd7ab78378174f209f0a9265944b7a90/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:35.283108 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9604638e96a4b4c88bca16d43088fb4, user_id=bd7ab78378174f209f0a9265944b7a90, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:35.285760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:35.399888 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1407/2831] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:49:35 2022] PUT /identity/v3/projects/e9604638e96a4b4c88bca16d43088fb4/users/bd7ab78378174f209f0a9265944b7a90/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:49:35.410016 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31759-a358-4133-bf17-d6bf7c0ee455 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:35.410344 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31759-a358-4133-bf17-d6bf7c0ee455 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:35.410619 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31759-a358-4133-bf17-d6bf7c0ee455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:35.438941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-10a31759-a358-4133-bf17-d6bf7c0ee455 None None] MFA Rules not processed for user `bd7ab78378174f209f0a9265944b7a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:35.440146 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-10a31759-a358-4133-bf17-d6bf7c0ee455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:35.503506 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1425/2832] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:35.515352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:35.517131 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:35.596179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55fa6-91f1-4bb5-9795-87ae4889a613 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:35.600790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a6b0b-0f46-44b7-8c2a-599efe465bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:35.601361 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a6b0b-0f46-44b7-8c2a-599efe465bfe service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:35.601638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a6b0b-0f46-44b7-8c2a-599efe465bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:35.601907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a6b0b-0f46-44b7-8c2a-599efe465bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:35.610501 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a6b0b-0f46-44b7-8c2a-599efe465bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:35.611900 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a6b0b-0f46-44b7-8c2a-599efe465bfe service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:35.621287 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1408/2833] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:49:38.677553 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a31759-a358-4133-bf17-d6bf7c0ee455 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:38.744266 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a31759-a358-4133-bf17-d6bf7c0ee455 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:38.748842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:38.749523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:38.749813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:38.750075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] PATH_INFO: `/v3/users/bd7ab78378174f209f0a9265944b7a90` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:38.751217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7ab78378174f209f0a9265944b7a90)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:38.753188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:38.912271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7ab78378174f209f0a9265944b7a90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:38.923189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:38.924372 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7ab78378174f209f0a9265944b7a90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:38.931708 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7ab78378174f209f0a9265944b7a90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:38.999783 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7ab78378174f209f0a9265944b7a90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:39.000528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7ab78378174f209f0a9265944b7a90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:39.006643 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1426/2834] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:49:38 2022] DELETE /identity/v3/users/bd7ab78378174f209f0a9265944b7a90 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:49:39.012449 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904bad-5d67-4a7b-a559-2f9ff179fd43 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:39.012942 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904bad-5d67-4a7b-a559-2f9ff179fd43 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:39.013043 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904bad-5d67-4a7b-a559-2f9ff179fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:39.026716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:39.033426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c6904bad-5d67-4a7b-a559-2f9ff179fd43 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:39.033747 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c6904bad-5d67-4a7b-a559-2f9ff179fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:39.109127 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1409/2835] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:39.119605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:39.121115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:39.177859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ad5d-d63f-4f21-b4a5-7b11618404cb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:39.182003 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6468-8dba-4427-b8de-e3c8fc54825d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:39.182606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6468-8dba-4427-b8de-e3c8fc54825d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:39.182888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6468-8dba-4427-b8de-e3c8fc54825d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:39.183162 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6468-8dba-4427-b8de-e3c8fc54825d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:39.192048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd6468-8dba-4427-b8de-e3c8fc54825d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:39.193499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd6468-8dba-4427-b8de-e3c8fc54825d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:39.202709 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1427/2836] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:49:39.618903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904bad-5d67-4a7b-a559-2f9ff179fd43 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:39.621683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c6904bad-5d67-4a7b-a559-2f9ff179fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:39.632961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904bad-5d67-4a7b-a559-2f9ff179fd43 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:39.638169 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:39.639089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:39.639373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:39.639649 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] PATH_INFO: `/v3/projects/e9604638e96a4b4c88bca16d43088fb4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:39.640866 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9604638e96a4b4c88bca16d43088fb4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:39.644594 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:39.748432 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9604638e96a4b4c88bca16d43088fb4', 'request_id': 'req-ec757e20-514a-4a17-a2d1-0350f558d3a0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:39.807804 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9604638e96a4b4c88bca16d43088fb4', 'request_id': 'req-ec757e20-514a-4a17-a2d1-0350f558d3a0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:39.814588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9604638e96a4b4c88bca16d43088fb4', 'request_id': 'req-ec757e20-514a-4a17-a2d1-0350f558d3a0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:39.825611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] The token cache is being invalidate because project e9604638e96a4b4c88bca16d43088fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:49:39.825903 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:39.826613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ec757e20-514a-4a17-a2d1-0350f558d3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:49:39.828139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1410/2837] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:49:39 2022] DELETE /identity/v3/projects/e9604638e96a4b4c88bca16d43088fb4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:49:39.833528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913991aa-4aa4-4fa1-b846-502563d13d55 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:39.833967 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913991aa-4aa4-4fa1-b846-502563d13d55 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:39.834089 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913991aa-4aa4-4fa1-b846-502563d13d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:39.854194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-913991aa-4aa4-4fa1-b846-502563d13d55 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:39.855401 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-913991aa-4aa4-4fa1-b846-502563d13d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:39.913133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1428/2838] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:39.921191 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749b93-c96f-4456-af01-1597682f44b3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:39.921478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749b93-c96f-4456-af01-1597682f44b3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:39.921754 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749b93-c96f-4456-af01-1597682f44b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:39.941394 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-50749b93-c96f-4456-af01-1597682f44b3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:39.942581 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-50749b93-c96f-4456-af01-1597682f44b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:39.950852 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1411/2839] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:39.954992 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913991aa-4aa4-4fa1-b846-502563d13d55 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:39.965080 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913991aa-4aa4-4fa1-b846-502563d13d55 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:39.969575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:39.970167 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:39.970453 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:39.970727 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:39.971371 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:49:39.971678 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:39.973321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:39.984683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1429/2840] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:49:39.988826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749b93-c96f-4456-af01-1597682f44b3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:39.997978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749b93-c96f-4456-af01-1597682f44b3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:40.002701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8dae-f98b-4d15-8fa4-cd2cd3709f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:40.003241 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8dae-f98b-4d15-8fa4-cd2cd3709f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:40.003520 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8dae-f98b-4d15-8fa4-cd2cd3709f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:40.003797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8dae-f98b-4d15-8fa4-cd2cd3709f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:40.004422 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad8dae-f98b-4d15-8fa4-cd2cd3709f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:40.006317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad8dae-f98b-4d15-8fa4-cd2cd3709f2b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:40.100038 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1412/2841] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:49:39 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:49:40.104337 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:40.114291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bc206-99c5-49a6-be4f-d96bfa060c48 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:40.170821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139c32c-ef12-4aaa-b2fe-5c97907e3b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:40.171432 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139c32c-ef12-4aaa-b2fe-5c97907e3b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:40.171716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139c32c-ef12-4aaa-b2fe-5c97907e3b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:40.171988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139c32c-ef12-4aaa-b2fe-5c97907e3b3e admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:40.172648 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139c32c-ef12-4aaa-b2fe-5c97907e3b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:40.174598 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139c32c-ef12-4aaa-b2fe-5c97907e3b3e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:40.260764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:40.265837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1430/2842] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:49:40 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:49:40.270019 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8dae-f98b-4d15-8fa4-cd2cd3709f2b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:40.280333 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8dae-f98b-4d15-8fa4-cd2cd3709f2b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:40.284870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc8eac-cd0e-4256-8cd0-d47dd068bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:40.285456 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8eac-cd0e-4256-8cd0-d47dd068bb7a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:40.285784 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8eac-cd0e-4256-8cd0-d47dd068bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:40.286058 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8eac-cd0e-4256-8cd0-d47dd068bb7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:40.286688 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc8eac-cd0e-4256-8cd0-d47dd068bb7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:40.288253 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc8eac-cd0e-4256-8cd0-d47dd068bb7a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:40.298352 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1413/2843] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:49:40.302325 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139c32c-ef12-4aaa-b2fe-5c97907e3b3e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:40.313049 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139c32c-ef12-4aaa-b2fe-5c97907e3b3e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:40.317632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a0825-9e82-4c47-9972-3f54de597c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:40.318234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a0825-9e82-4c47-9972-3f54de597c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:40.321955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a0825-9e82-4c47-9972-3f54de597c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:40.321955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a0825-9e82-4c47-9972-3f54de597c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:40.321955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a0825-9e82-4c47-9972-3f54de597c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:40.321955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a0825-9e82-4c47-9972-3f54de597c4f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:40.332151 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1431/2844] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:49:40.336263 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc8eac-cd0e-4256-8cd0-d47dd068bb7a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:40.346442 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc8eac-cd0e-4256-8cd0-d47dd068bb7a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:40.351022 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:40.351661 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:40.351940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:40.352209 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] PATH_INFO: `/v3/projects/abac9835b5dd48248ba4f7d77ea8d7f5/users/a4a0d76fa5a54a729b0e4862a6c88de7/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:40.368189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abac9835b5dd48248ba4f7d77ea8d7f5, user_id=a4a0d76fa5a54a729b0e4862a6c88de7, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:40.370791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:40.436733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1414/2845] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:49:40 2022] PUT /identity/v3/projects/abac9835b5dd48248ba4f7d77ea8d7f5/users/a4a0d76fa5a54a729b0e4862a6c88de7/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:49:40.441871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de4311-e881-40cd-b908-012ae4153020 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:40.442190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de4311-e881-40cd-b908-012ae4153020 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:40.442464 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de4311-e881-40cd-b908-012ae4153020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:40.462038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-43de4311-e881-40cd-b908-012ae4153020 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:40.463253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-43de4311-e881-40cd-b908-012ae4153020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:40.522690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1432/2846] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:40.533200 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:40.534881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:40.566280 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:40.593218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48976ef6-bbc7-4aa3-b041-f029e7969761 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:40.596910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c01ac-e753-4f1d-92ee-ee6bdf4effd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:40.597514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c01ac-e753-4f1d-92ee-ee6bdf4effd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:40.597796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c01ac-e753-4f1d-92ee-ee6bdf4effd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:40.598069 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c01ac-e753-4f1d-92ee-ee6bdf4effd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:40.607620 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c01ac-e753-4f1d-92ee-ee6bdf4effd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:40.609080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c01ac-e753-4f1d-92ee-ee6bdf4effd7 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:40.618672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1415/2847] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:49:45.871354 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715cb0-b088-4747-881b-39f7014e1ea9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:45.871876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715cb0-b088-4747-881b-39f7014e1ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:45.871964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715cb0-b088-4747-881b-39f7014e1ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:45.904829 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b1715cb0-b088-4747-881b-39f7014e1ea9 None None] MFA Rules not processed for user `a4a0d76fa5a54a729b0e4862a6c88de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:45.906110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b1715cb0-b088-4747-881b-39f7014e1ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:45.982290 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1433/2848] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:45.986910 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c01ac-e753-4f1d-92ee-ee6bdf4effd7 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:46.000458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c01ac-e753-4f1d-92ee-ee6bdf4effd7 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:46.005395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdb860-7120-4548-86c7-9a8dcc5bfaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:46.006000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb860-7120-4548-86c7-9a8dcc5bfaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:46.006279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb860-7120-4548-86c7-9a8dcc5bfaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:46.018632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdb860-7120-4548-86c7-9a8dcc5bfaf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:46.018632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdb860-7120-4548-86c7-9a8dcc5bfaf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:46.018632 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdb860-7120-4548-86c7-9a8dcc5bfaf9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:46.115848 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1416/2849] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:49:45 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:49:46.121979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1715cb0-b088-4747-881b-39f7014e1ea9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:46.133361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1715cb0-b088-4747-881b-39f7014e1ea9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:46.191549 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7850-25df-437a-b6de-88fd1f7d5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:46.192188 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7850-25df-437a-b6de-88fd1f7d5571 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:46.192469 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7850-25df-437a-b6de-88fd1f7d5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:46.192774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7850-25df-437a-b6de-88fd1f7d5571 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:46.193443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7850-25df-437a-b6de-88fd1f7d5571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:46.195759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7850-25df-437a-b6de-88fd1f7d5571 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:46.322720 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1434/2850] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:49:46 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:49:46.326755 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdb860-7120-4548-86c7-9a8dcc5bfaf9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:46.337967 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdb860-7120-4548-86c7-9a8dcc5bfaf9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:46.342608 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b135a-2ef4-4610-9c23-6dc6cd04855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:46.343216 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b135a-2ef4-4610-9c23-6dc6cd04855b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:46.343651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b135a-2ef4-4610-9c23-6dc6cd04855b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:46.343833 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b135a-2ef4-4610-9c23-6dc6cd04855b admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:46.344496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b135a-2ef4-4610-9c23-6dc6cd04855b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:46.346080 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b135a-2ef4-4610-9c23-6dc6cd04855b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:46.357871 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1417/2851] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:49:46.362062 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7850-25df-437a-b6de-88fd1f7d5571 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:46.372124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7850-25df-437a-b6de-88fd1f7d5571 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:46.376666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8d71-6f49-41a1-97e3-735593f9f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:46.377313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8d71-6f49-41a1-97e3-735593f9f130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:46.377588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8d71-6f49-41a1-97e3-735593f9f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:46.377864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8d71-6f49-41a1-97e3-735593f9f130 admin admin] PATH_INFO: `/v3/projects/5e2cc42bb5544198bcfa8617c7fccb73/users/6dc5f56f47974d3a9e6ea5cc1cef613a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:46.380895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:46.393480 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c8d71-6f49-41a1-97e3-735593f9f130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2cc42bb5544198bcfa8617c7fccb73, user_id=6dc5f56f47974d3a9e6ea5cc1cef613a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:46.396127 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c8d71-6f49-41a1-97e3-735593f9f130 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:46.488874 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1435/2852] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:49:46 2022] PUT /identity/v3/projects/5e2cc42bb5544198bcfa8617c7fccb73/users/6dc5f56f47974d3a9e6ea5cc1cef613a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:49:46.492841 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b135a-2ef4-4610-9c23-6dc6cd04855b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:46.503458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b135a-2ef4-4610-9c23-6dc6cd04855b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:46.565274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e264901-e4d5-464d-b695-5889328837d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:46.565918 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264901-e4d5-464d-b695-5889328837d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:46.566193 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264901-e4d5-464d-b695-5889328837d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:46.567678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e264901-e4d5-464d-b695-5889328837d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:46.567678 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e264901-e4d5-464d-b695-5889328837d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:46.569013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e264901-e4d5-464d-b695-5889328837d0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:46.579651 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1418/2853] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:49:46.583918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8d71-6f49-41a1-97e3-735593f9f130 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:46.595207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8d71-6f49-41a1-97e3-735593f9f130 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:46.599952 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:46.600681 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:46.600958 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:46.601250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] PATH_INFO: `/v3/projects/5e2cc42bb5544198bcfa8617c7fccb73/users/6dc5f56f47974d3a9e6ea5cc1cef613a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:46.603502 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2cc42bb5544198bcfa8617c7fccb73, user_id=6dc5f56f47974d3a9e6ea5cc1cef613a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:46.606402 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:46.621314 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1436/2854] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:49:46 2022] PUT /identity/v3/projects/5e2cc42bb5544198bcfa8617c7fccb73/users/6dc5f56f47974d3a9e6ea5cc1cef613a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:49:52.021844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70958db4-7bbb-43cb-b525-ed3f1376fafc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:52.022408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70958db4-7bbb-43cb-b525-ed3f1376fafc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:52.022408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70958db4-7bbb-43cb-b525-ed3f1376fafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:52.052654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-70958db4-7bbb-43cb-b525-ed3f1376fafc None None] MFA Rules not processed for user `6dc5f56f47974d3a9e6ea5cc1cef613a`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:52.053885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-70958db4-7bbb-43cb-b525-ed3f1376fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:52.131424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1419/2855] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:52.139880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:52.141642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:52.205322 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a096c-0b8c-486c-ad2d-a32fbcfda50a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:52.208979 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa1d30decad84c7081c7e150812b2964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:52.209601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:52.209878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:52.210154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:52.271405 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:52.273073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:52.283737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1437/2856] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:49:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:49:52.572309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347fcec-a97e-4c48-bd86-ba6ba01e4bb3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:52.572309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347fcec-a97e-4c48-bd86-ba6ba01e4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:52.572309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347fcec-a97e-4c48-bd86-ba6ba01e4bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:52.589792 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8347fcec-a97e-4c48-bd86-ba6ba01e4bb3 None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:49:52.590987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8347fcec-a97e-4c48-bd86-ba6ba01e4bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:52.603542 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:52.647465 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1420/2857] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:49:52.660176 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:49:52.661642 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:49:52.731837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b01b-726b-4d92-ba9c-c45196337a62 service glance] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:49:52.736925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514744-8df2-4a44-9c87-892db2768a7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:49:52.737541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514744-8df2-4a44-9c87-892db2768a7b service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:49:52.737827 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514744-8df2-4a44-9c87-892db2768a7b service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:49:52.738106 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514744-8df2-4a44-9c87-892db2768a7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:49:52.746624 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c514744-8df2-4a44-9c87-892db2768a7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:49:52.748263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c514744-8df2-4a44-9c87-892db2768a7b service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:49:52.756823 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1438/2858] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:49:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:02.745140 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=17 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:02.753195 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:03.819489 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cca68-57a5-41d6-aa0b-a18716dcd23c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:03.819995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cca68-57a5-41d6-aa0b-a18716dcd23c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:03.819995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cca68-57a5-41d6-aa0b-a18716dcd23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:03.840648 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e69cca68-57a5-41d6-aa0b-a18716dcd23c None None] MFA Rules not processed for user `a4a0d76fa5a54a729b0e4862a6c88de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:50:03.842712 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e69cca68-57a5-41d6-aa0b-a18716dcd23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:03.848786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1421/2859] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:50:04.112471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514744-8df2-4a44-9c87-892db2768a7b service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:04.170217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514744-8df2-4a44-9c87-892db2768a7b service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:04.173781 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:04.174382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:04.174666 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:04.174941 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:04.176736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:04.186830 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:04.188259 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:04.196799 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1439/2860] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:50:07.408922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f31f7-a9ce-4a07-998c-0c54ae6d3d10 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:07.409538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f31f7-a9ce-4a07-998c-0c54ae6d3d10 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:07.410123 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f31f7-a9ce-4a07-998c-0c54ae6d3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:07.437540 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a25f31f7-a9ce-4a07-998c-0c54ae6d3d10 None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:50:07.439365 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a25f31f7-a9ce-4a07-998c-0c54ae6d3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:07.449039 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1422/2861] 10.222.0.75 () {58 vars in 1009 bytes} [Mon Sep 19 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:50:07.461155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:07.474154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41684b4-e725-4f14-9538-480564c09162 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:07.479897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:07.480547 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:07.480836 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:07.481113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:07.489756 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:07.491385 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:07.499690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1440/2862] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:50:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:09.259407 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f31f7-a9ce-4a07-998c-0c54ae6d3d10 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:09.282774 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f31f7-a9ce-4a07-998c-0c54ae6d3d10 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:09.286554 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:09.287173 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:09.287451 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:09.287724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:09.289497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:09.379602 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:09.381081 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:09.417493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1423/2863] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:50:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:50:17.496505 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=32 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:19.406290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=56 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:41.554972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:41.556381 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:41.616041 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019301d0-5f76-4ab1-abea-bb2e83a7ebc8 service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:41.622166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:41.622166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:41.622166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:41.622166 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:41.623814 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:41.674623 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:41.676218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:41.689856 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff5ce4-a519-4198-bedc-44e8363b0950 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:41.694180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:41.694881 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:41.695231 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:41.695582 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:41.701443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:41.702934 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:41.705812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:41.708320 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:41.713423 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1441/2864] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:50:41.718511 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1424/2865] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:50:42.066273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:42.067684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:42.079382 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ff76-5311-4877-b18a-bdbed9fa2534 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:42.083194 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:42.083910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:42.084230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:42.084529 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:42.093625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:42.095042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:42.104897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1442/2866] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:50:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:50:44.000112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:44.009188 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:44.020760 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b030c-c819-4568-9a0a-2578d9263772 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:44.027478 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:44.028126 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:44.028408 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:44.028706 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:44.030625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:44.044629 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:44.046232 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:44.057385 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1425/2867] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:50:47.313736 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:47.315183 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:47.333730 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e876d1-ee55-4a78-8586-80fec6c70214 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:47.341676 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:47.342494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:47.342876 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:47.343254 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:47.345525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:47.361305 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:47.363302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:47.375587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1443/2868] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:50:49.432103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:50:49.444508 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cc6b7-c2a5-4268-8581-7e2921f73e8e service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:50:49.448190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:50:49.448898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:50:49.449176 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:50:49.449509 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:50:49.451277 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:50:49.467862 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:50:49.469358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:50:49.481017 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1426/2869] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:50:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:50:57.369792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=60 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:59.477161 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=18 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:00.900299 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:00.910434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc64d-0173-40f9-9f0e-f2f896d087fc service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:00.913968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:00.914566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:00.914851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:00.915127 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:00.916888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:00.979301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:00.980764 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:00.990597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1444/2870] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:04.764276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:04.766016 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:04.836441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c48871-6014-4692-9de6-9ce3d78fae8c service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:04.842368 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:04.842965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:04.843243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:04.843516 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:04.845279 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:04.856749 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:04.858345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:04.869565 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1427/2871] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:51:04.922522 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:04.924056 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:04.939472 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492102b1-1b4c-43a9-8ff2-b236d53393b4 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:04.944647 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:04.945338 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:04.945641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:04.945892 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] PATH_INFO: `/v3/users/fb7200a9769b46b3a79c9fe6287a1724` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:04.960785 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7200a9769b46b3a79c9fe6287a1724)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:04.962753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:05.131669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7200a9769b46b3a79c9fe6287a1724'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.146586 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7200a9769b46b3a79c9fe6287a1724'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.153577 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7200a9769b46b3a79c9fe6287a1724'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.209467 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7200a9769b46b3a79c9fe6287a1724'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.210113 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-729eb9f9-3da7-45bb-8f99-21a26718a4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7200a9769b46b3a79c9fe6287a1724'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.216576 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1445/2872] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:04 2022] DELETE /identity/v3/users/fb7200a9769b46b3a79c9fe6287a1724 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:05.465753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:05.487258 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab7d6-48f3-40cf-aa50-523af33aecfa service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:05.547795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:05.548426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:05.548730 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:05.549000 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] PATH_INFO: `/v3/projects/13d5af34cdc54fd8be3b076c629e2cbd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:05.561185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d5af34cdc54fd8be3b076c629e2cbd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:05.563114 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:05.711144 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d5af34cdc54fd8be3b076c629e2cbd', 'request_id': 'req-0428fe45-0f20-4990-8469-6fdb4d0b910f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.800723 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d5af34cdc54fd8be3b076c629e2cbd', 'request_id': 'req-0428fe45-0f20-4990-8469-6fdb4d0b910f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.808207 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d5af34cdc54fd8be3b076c629e2cbd', 'request_id': 'req-0428fe45-0f20-4990-8469-6fdb4d0b910f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.819299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] The token cache is being invalidate because project 13d5af34cdc54fd8be3b076c629e2cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:05.819591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.821998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0428fe45-0f20-4990-8469-6fdb4d0b910f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:05.821998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1428/2873] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:05 2022] DELETE /identity/v3/projects/13d5af34cdc54fd8be3b076c629e2cbd => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:05.826903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3906-cef2-48cb-b536-482d6a3a36c3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:05.827190 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3906-cef2-48cb-b536-482d6a3a36c3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:05.827499 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3906-cef2-48cb-b536-482d6a3a36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:05.848234 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-18ec3906-cef2-48cb-b536-482d6a3a36c3 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:05.850689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-18ec3906-cef2-48cb-b536-482d6a3a36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:05.897250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:05.908893 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1446/2874] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:05.917899 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307933a-d351-4ba5-8ea8-f2531e4a07bd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:05.918251 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307933a-d351-4ba5-8ea8-f2531e4a07bd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:05.918590 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307933a-d351-4ba5-8ea8-f2531e4a07bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:05.938357 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8307933a-d351-4ba5-8ea8-f2531e4a07bd None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:05.939547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8307933a-d351-4ba5-8ea8-f2531e4a07bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:05.947222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1429/2875] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:05.951954 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3906-cef2-48cb-b536-482d6a3a36c3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:05.961559 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3906-cef2-48cb-b536-482d6a3a36c3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:05.967523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:05.968131 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:05.968417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:05.968758 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:05.969419 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:51:05.969724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:05.971334 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:05.982847 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1447/2876] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:51:05.987276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307933a-d351-4ba5-8ea8-f2531e4a07bd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:05.992864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:05.996578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307933a-d351-4ba5-8ea8-f2531e4a07bd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:06.001141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0b2aa-3439-4491-a0f3-d2ed8c4d5aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:06.001733 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0b2aa-3439-4491-a0f3-d2ed8c4d5aee admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:06.004947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0b2aa-3439-4491-a0f3-d2ed8c4d5aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:06.004947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0b2aa-3439-4491-a0f3-d2ed8c4d5aee admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:06.004947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0b2aa-3439-4491-a0f3-d2ed8c4d5aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:06.004947 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0b2aa-3439-4491-a0f3-d2ed8c4d5aee admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:06.084555 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1430/2877] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:51:05 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:06.088757 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:06.099687 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a70e3-acaa-4230-a38c-9dc9d6268c12 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:06.157662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba23de9-f3cd-4ea5-8797-c12ebfe22469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:06.158281 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba23de9-f3cd-4ea5-8797-c12ebfe22469 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:06.158554 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba23de9-f3cd-4ea5-8797-c12ebfe22469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:06.158833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba23de9-f3cd-4ea5-8797-c12ebfe22469 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:06.159455 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba23de9-f3cd-4ea5-8797-c12ebfe22469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:06.161427 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba23de9-f3cd-4ea5-8797-c12ebfe22469 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:06.232520 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1448/2878] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:51:06 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:06.236704 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0b2aa-3439-4491-a0f3-d2ed8c4d5aee admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:06.246890 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0b2aa-3439-4491-a0f3-d2ed8c4d5aee admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:06.251521 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec09aaf-9b1f-4436-b903-0de49225d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:06.252118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09aaf-9b1f-4436-b903-0de49225d760 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:06.252397 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09aaf-9b1f-4436-b903-0de49225d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:06.252705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09aaf-9b1f-4436-b903-0de49225d760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:06.253344 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec09aaf-9b1f-4436-b903-0de49225d760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:06.254952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec09aaf-9b1f-4436-b903-0de49225d760 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:06.265679 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1431/2879] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:06.269626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba23de9-f3cd-4ea5-8797-c12ebfe22469 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:06.280539 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba23de9-f3cd-4ea5-8797-c12ebfe22469 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:06.285215 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d2f5c-3d25-41f8-bbdd-838ea95aa536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:06.285813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2f5c-3d25-41f8-bbdd-838ea95aa536 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:06.286114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2f5c-3d25-41f8-bbdd-838ea95aa536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:06.286370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2f5c-3d25-41f8-bbdd-838ea95aa536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:06.287042 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d2f5c-3d25-41f8-bbdd-838ea95aa536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:06.288674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d2f5c-3d25-41f8-bbdd-838ea95aa536 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:06.299588 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1449/2880] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:51:06.303716 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec09aaf-9b1f-4436-b903-0de49225d760 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:06.313843 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec09aaf-9b1f-4436-b903-0de49225d760 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:06.318445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:06.319098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:06.319380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:06.319674 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] PATH_INFO: `/v3/projects/bc7bcbaefeff47e4ab92d2643061e1bd/users/64740f869929480bbe5bd477977171c4/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:06.334603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7bcbaefeff47e4ab92d2643061e1bd, user_id=64740f869929480bbe5bd477977171c4, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:06.337290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:06.432308 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1432/2881] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:06 2022] PUT /identity/v3/projects/bc7bcbaefeff47e4ab92d2643061e1bd/users/64740f869929480bbe5bd477977171c4/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:06.443606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1a345-6d80-4f1c-b88a-943417a53b5b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:06.443925 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1a345-6d80-4f1c-b88a-943417a53b5b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:06.444203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1a345-6d80-4f1c-b88a-943417a53b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:06.472932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9fa1a345-6d80-4f1c-b88a-943417a53b5b None None] MFA Rules not processed for user `64740f869929480bbe5bd477977171c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:06.474149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9fa1a345-6d80-4f1c-b88a-943417a53b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:06.540434 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1450/2882] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:06.551371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:06.553247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:06.609655 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf572dd-2881-4a62-b4a3-16bdafa125a0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:06.613383 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961628ee-9078-4035-8aac-9833f1cc3395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:06.613963 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961628ee-9078-4035-8aac-9833f1cc3395 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:06.614243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961628ee-9078-4035-8aac-9833f1cc3395 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:06.614510 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961628ee-9078-4035-8aac-9833f1cc3395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:06.623775 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961628ee-9078-4035-8aac-9833f1cc3395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:06.625228 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961628ee-9078-4035-8aac-9833f1cc3395 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:06.633898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1433/2883] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:16.199988 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1a345-6d80-4f1c-b88a-943417a53b5b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:16.252134 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:16.264659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1a345-6d80-4f1c-b88a-943417a53b5b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:16.269376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:16.270000 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:16.272364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:16.272364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] PATH_INFO: `/v3/users/64740f869929480bbe5bd477977171c4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:16.272572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64740f869929480bbe5bd477977171c4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:16.275674 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:16.477475 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64740f869929480bbe5bd477977171c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:16.489433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64740f869929480bbe5bd477977171c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:16.496329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64740f869929480bbe5bd477977171c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:16.606523 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64740f869929480bbe5bd477977171c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:16.607157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64740f869929480bbe5bd477977171c4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:16.613922 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1451/2884] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:16 2022] DELETE /identity/v3/users/64740f869929480bbe5bd477977171c4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:16.618426 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0ebe7-aa84-4b37-9f39-0adb27d15e1b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:16.618892 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0ebe7-aa84-4b37-9f39-0adb27d15e1b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:16.618982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0ebe7-aa84-4b37-9f39-0adb27d15e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:16.638313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d4d0ebe7-aa84-4b37-9f39-0adb27d15e1b None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:16.640299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d4d0ebe7-aa84-4b37-9f39-0adb27d15e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:16.700440 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1434/2885] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:16.711048 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:16.712443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:16.770413 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358861c7-2e59-41e5-a058-8f86213fa1d7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:16.773962 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8def45d-1501-4bff-ac43-6867936d2cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:16.774561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8def45d-1501-4bff-ac43-6867936d2cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:16.774837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8def45d-1501-4bff-ac43-6867936d2cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:16.775105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8def45d-1501-4bff-ac43-6867936d2cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:16.784462 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8def45d-1501-4bff-ac43-6867936d2cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:16.785931 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8def45d-1501-4bff-ac43-6867936d2cd5 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:16.795431 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1452/2886] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:17.222991 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0ebe7-aa84-4b37-9f39-0adb27d15e1b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:17.224708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d4d0ebe7-aa84-4b37-9f39-0adb27d15e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:17.238992 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0ebe7-aa84-4b37-9f39-0adb27d15e1b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:17.243719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:17.244354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:17.244671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:17.244950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] PATH_INFO: `/v3/projects/bc7bcbaefeff47e4ab92d2643061e1bd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:17.246166 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7bcbaefeff47e4ab92d2643061e1bd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:17.248109 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:17.338371 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:17.341192 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7bcbaefeff47e4ab92d2643061e1bd', 'request_id': 'req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:17.431987 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7bcbaefeff47e4ab92d2643061e1bd', 'request_id': 'req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:17.438588 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7bcbaefeff47e4ab92d2643061e1bd', 'request_id': 'req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:17.449382 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] The token cache is being invalidate because project bc7bcbaefeff47e4ab92d2643061e1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:17.449671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:17.450321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-daf9b9bf-b9f2-4ca7-b578-444a3c8da3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:17.451898 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1435/2887] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:17 2022] DELETE /identity/v3/projects/bc7bcbaefeff47e4ab92d2643061e1bd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:51:17.456869 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b7de-60bc-4fa2-9f0b-5ed326445f78 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:17.457351 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b7de-60bc-4fa2-9f0b-5ed326445f78 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:17.457446 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b7de-60bc-4fa2-9f0b-5ed326445f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:17.477301 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e133b7de-60bc-4fa2-9f0b-5ed326445f78 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:17.478504 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e133b7de-60bc-4fa2-9f0b-5ed326445f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:17.538376 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1453/2888] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:17.546941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074308-6176-49ff-812d-db704ba5c063 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:17.547463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074308-6176-49ff-812d-db704ba5c063 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:17.547763 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074308-6176-49ff-812d-db704ba5c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:17.567544 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-85074308-6176-49ff-812d-db704ba5c063 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:17.568791 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-85074308-6176-49ff-812d-db704ba5c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:17.577682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1436/2889] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:17.581853 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133b7de-60bc-4fa2-9f0b-5ed326445f78 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:17.592384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133b7de-60bc-4fa2-9f0b-5ed326445f78 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:17.596994 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:17.599500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:17.599500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:17.599500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:17.599500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:51:17.599500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:17.600721 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:17.609848 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:17.613136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1454/2890] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:51:17.617446 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85074308-6176-49ff-812d-db704ba5c063 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:17.626660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85074308-6176-49ff-812d-db704ba5c063 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:17.631445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd33d5-c9b1-4cbc-9f83-f0077955179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:17.632040 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd33d5-c9b1-4cbc-9f83-f0077955179f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:17.632353 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd33d5-c9b1-4cbc-9f83-f0077955179f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:17.632618 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd33d5-c9b1-4cbc-9f83-f0077955179f admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:17.633245 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd33d5-c9b1-4cbc-9f83-f0077955179f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:17.635107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd33d5-c9b1-4cbc-9f83-f0077955179f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:17.738711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1437/2891] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:51:17 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:17.744267 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:17.754706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c776b-65ab-48b7-8960-d352e7cf82b1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:17.814450 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470a46-8252-4c57-a55c-fa41e6841514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:17.815046 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470a46-8252-4c57-a55c-fa41e6841514 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:17.815326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470a46-8252-4c57-a55c-fa41e6841514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:17.815597 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470a46-8252-4c57-a55c-fa41e6841514 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:17.816230 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470a46-8252-4c57-a55c-fa41e6841514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:17.818171 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470a46-8252-4c57-a55c-fa41e6841514 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:17.920435 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1455/2892] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:51:17 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:17.924506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd33d5-c9b1-4cbc-9f83-f0077955179f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:17.934785 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd33d5-c9b1-4cbc-9f83-f0077955179f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:17.939766 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ecf96-59f1-4524-92c2-a7d229186b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:17.940387 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ecf96-59f1-4524-92c2-a7d229186b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:17.940693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ecf96-59f1-4524-92c2-a7d229186b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:17.940998 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ecf96-59f1-4524-92c2-a7d229186b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:17.941667 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ecf96-59f1-4524-92c2-a7d229186b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:17.943211 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ecf96-59f1-4524-92c2-a7d229186b44 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:17.954027 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1438/2893] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:17.958021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470a46-8252-4c57-a55c-fa41e6841514 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:17.968775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470a46-8252-4c57-a55c-fa41e6841514 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:17.973433 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbc376-75d4-431d-865e-6d19a2128eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:17.974022 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc376-75d4-431d-865e-6d19a2128eca admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:17.974302 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc376-75d4-431d-865e-6d19a2128eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:17.974575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbc376-75d4-431d-865e-6d19a2128eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:17.975209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc376-75d4-431d-865e-6d19a2128eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:17.976822 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbc376-75d4-431d-865e-6d19a2128eca admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:17.987239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1456/2894] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:17.991482 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ecf96-59f1-4524-92c2-a7d229186b44 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:18.002118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ecf96-59f1-4524-92c2-a7d229186b44 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:18.006738 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:18.007376 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:18.007658 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:18.007935 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] PATH_INFO: `/v3/projects/dcd067011e75458a85cbae4d2a2cd8e8/users/8f3068c37e174f84a83fd7f1e8b1e29b/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:18.023035 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd067011e75458a85cbae4d2a2cd8e8, user_id=8f3068c37e174f84a83fd7f1e8b1e29b, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:18.025676 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:18.120269 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1439/2895] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:17 2022] PUT /identity/v3/projects/dcd067011e75458a85cbae4d2a2cd8e8/users/8f3068c37e174f84a83fd7f1e8b1e29b/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:18.188903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf359-cbf5-4303-8d78-59432ddf43b9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:18.189105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf359-cbf5-4303-8d78-59432ddf43b9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:18.189375 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf359-cbf5-4303-8d78-59432ddf43b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:18.217114 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-19cdf359-cbf5-4303-8d78-59432ddf43b9 None None] MFA Rules not processed for user `8f3068c37e174f84a83fd7f1e8b1e29b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:18.218327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-19cdf359-cbf5-4303-8d78-59432ddf43b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:18.281105 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1457/2896] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:18.292083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:18.293780 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:18.367895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdbcf-bd74-43d0-89f8-e5d63482483d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:18.373580 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c9f6-8009-4fa5-b849-e092ac8c36fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab4bb702760a4cd2b2cbf6f732b2360b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:18.374180 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c9f6-8009-4fa5-b849-e092ac8c36fa service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:18.374482 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c9f6-8009-4fa5-b849-e092ac8c36fa service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:18.374793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c9f6-8009-4fa5-b849-e092ac8c36fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:18.382492 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c9f6-8009-4fa5-b849-e092ac8c36fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:18.384125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c9f6-8009-4fa5-b849-e092ac8c36fa service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:18.393689 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1440/2897] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:18.604723 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdf359-cbf5-4303-8d78-59432ddf43b9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:18.675454 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdf359-cbf5-4303-8d78-59432ddf43b9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:18.679899 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:18.680560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:18.680844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:18.681120 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] PATH_INFO: `/v3/users/8f3068c37e174f84a83fd7f1e8b1e29b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:18.682235 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3068c37e174f84a83fd7f1e8b1e29b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:18.684157 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:18.694916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:18.911527 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3068c37e174f84a83fd7f1e8b1e29b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:18.923911 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3068c37e174f84a83fd7f1e8b1e29b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:18.930891 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3068c37e174f84a83fd7f1e8b1e29b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:18.995205 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3068c37e174f84a83fd7f1e8b1e29b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:18.995871 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3068c37e174f84a83fd7f1e8b1e29b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:19.005684 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1458/2898] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:18 2022] DELETE /identity/v3/users/8f3068c37e174f84a83fd7f1e8b1e29b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:19.011578 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ec83-23ba-485e-9530-b6a8daee8970 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:19.012044 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ec83-23ba-485e-9530-b6a8daee8970 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:19.012142 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ec83-23ba-485e-9530-b6a8daee8970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:19.034074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0c79ec83-23ba-485e-9530-b6a8daee8970 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:19.035189 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c79ec83-23ba-485e-9530-b6a8daee8970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:19.081566 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:19.092493 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1441/2899] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:19.102471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:19.103916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:19.160250 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbc86b-6002-4e26-9923-194841473dda admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:19.163793 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bbb85-bab9-4076-af7c-17a462f5b47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:19.164384 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bbb85-bab9-4076-af7c-17a462f5b47d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:19.164685 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bbb85-bab9-4076-af7c-17a462f5b47d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:19.164955 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bbb85-bab9-4076-af7c-17a462f5b47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:19.174227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bbb85-bab9-4076-af7c-17a462f5b47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:19.175625 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bbb85-bab9-4076-af7c-17a462f5b47d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:19.184777 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1459/2900] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:19.587877 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ec83-23ba-485e-9530-b6a8daee8970 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:19.590063 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c79ec83-23ba-485e-9530-b6a8daee8970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:19.601702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ec83-23ba-485e-9530-b6a8daee8970 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:19.606591 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:19.607222 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:19.608354 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:19.608739 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] PATH_INFO: `/v3/projects/dcd067011e75458a85cbae4d2a2cd8e8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:19.609920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd067011e75458a85cbae4d2a2cd8e8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:19.611820 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:19.764334 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd067011e75458a85cbae4d2a2cd8e8', 'request_id': 'req-3b602860-ed76-4c29-b741-7bf5ead12132'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:19.829077 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd067011e75458a85cbae4d2a2cd8e8', 'request_id': 'req-3b602860-ed76-4c29-b741-7bf5ead12132'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:19.837273 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd067011e75458a85cbae4d2a2cd8e8', 'request_id': 'req-3b602860-ed76-4c29-b741-7bf5ead12132'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:19.849445 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] The token cache is being invalidate because project dcd067011e75458a85cbae4d2a2cd8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:19.849680 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:19.850331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b602860-ed76-4c29-b741-7bf5ead12132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:19.851817 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1442/2901] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:19 2022] DELETE /identity/v3/projects/dcd067011e75458a85cbae4d2a2cd8e8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:19.858689 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdda9a-38f0-4051-84a8-508311d2c6f4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:19.859154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdda9a-38f0-4051-84a8-508311d2c6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:19.861008 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdda9a-38f0-4051-84a8-508311d2c6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:19.879540 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cecdda9a-38f0-4051-84a8-508311d2c6f4 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:19.880774 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cecdda9a-38f0-4051-84a8-508311d2c6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:19.943683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1460/2902] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:51:19.952389 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0abc8-2cb3-44c8-9b69-8671d7fbf0f6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:19.952837 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0abc8-2cb3-44c8-9b69-8671d7fbf0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:19.953247 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0abc8-2cb3-44c8-9b69-8671d7fbf0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:19.973695 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e7a0abc8-2cb3-44c8-9b69-8671d7fbf0f6 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:19.974914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e7a0abc8-2cb3-44c8-9b69-8671d7fbf0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:19.983574 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1443/2903] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:19.988155 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdda9a-38f0-4051-84a8-508311d2c6f4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:19.997947 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdda9a-38f0-4051-84a8-508311d2c6f4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.003138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.003759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.004038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.004309 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.004982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:51:20.005284 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.006916 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:20.019239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1461/2904] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:51:20.023764 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0abc8-2cb3-44c8-9b69-8671d7fbf0f6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:20.033380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0abc8-2cb3-44c8-9b69-8671d7fbf0f6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.038359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6bd6-0cd1-4dbe-a868-c41955ba2aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.038960 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6bd6-0cd1-4dbe-a868-c41955ba2aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.039235 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6bd6-0cd1-4dbe-a868-c41955ba2aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.039502 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6bd6-0cd1-4dbe-a868-c41955ba2aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.040130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d6bd6-0cd1-4dbe-a868-c41955ba2aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.046196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d6bd6-0cd1-4dbe-a868-c41955ba2aaa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:20.153982 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1444/2905] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:51:20 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:20.159124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:20.169064 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558657-8b43-476d-a8ca-580155e3660b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.181930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:20.225753 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.226348 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.226626 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.226903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.227526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.229449 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:20.404837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1462/2906] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:51:20 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:51:20.408971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6bd6-0cd1-4dbe-a868-c41955ba2aaa admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:20.419074 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6bd6-0cd1-4dbe-a868-c41955ba2aaa admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.421040 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:20.422811 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:20.424647 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a74a-80be-423d-8c7f-34af2e287f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.425359 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a74a-80be-423d-8c7f-34af2e287f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.425641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a74a-80be-423d-8c7f-34af2e287f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.425914 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a74a-80be-423d-8c7f-34af2e287f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.426558 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a74a-80be-423d-8c7f-34af2e287f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.428135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a74a-80be-423d-8c7f-34af2e287f7e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:20.438753 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1445/2907] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:51:20.444937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a74a-80be-423d-8c7f-34af2e287f7e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:20.454795 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a74a-80be-423d-8c7f-34af2e287f7e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.459278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980043e9-16d8-4f13-920d-ad083db3db5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.459857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980043e9-16d8-4f13-920d-ad083db3db5d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.460132 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980043e9-16d8-4f13-920d-ad083db3db5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.460406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980043e9-16d8-4f13-920d-ad083db3db5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.461062 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980043e9-16d8-4f13-920d-ad083db3db5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.462626 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980043e9-16d8-4f13-920d-ad083db3db5d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:20.474715 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1446/2908] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:51:20.478724 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980043e9-16d8-4f13-920d-ad083db3db5d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:20.486932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c6783-9d69-4786-939a-2e80b8caaf04 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.489525 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980043e9-16d8-4f13-920d-ad083db3db5d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.490568 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494e52d-49fb-4a75-b072-142cba7eaf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.491203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e52d-49fb-4a75-b072-142cba7eaf0b service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.491444 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e52d-49fb-4a75-b072-142cba7eaf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.491716 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494e52d-49fb-4a75-b072-142cba7eaf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.493452 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6494e52d-49fb-4a75-b072-142cba7eaf0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:20.494278 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11df3f-a7ba-46aa-a33f-95ff0939a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.494952 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11df3f-a7ba-46aa-a33f-95ff0939a500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.495236 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11df3f-a7ba-46aa-a33f-95ff0939a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.495541 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11df3f-a7ba-46aa-a33f-95ff0939a500 admin admin] PATH_INFO: `/v3/projects/60597d60587d4f728853bdd72ba68a07/users/48319f049a61404da7b56970bc271759/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.503071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494e52d-49fb-4a75-b072-142cba7eaf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.504510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494e52d-49fb-4a75-b072-142cba7eaf0b service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:20.512301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11df3f-a7ba-46aa-a33f-95ff0939a500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60597d60587d4f728853bdd72ba68a07, user_id=48319f049a61404da7b56970bc271759, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.512845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1463/2909] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:51:20.515045 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11df3f-a7ba-46aa-a33f-95ff0939a500 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:20.603230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1447/2910] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:20 2022] PUT /identity/v3/projects/60597d60587d4f728853bdd72ba68a07/users/48319f049a61404da7b56970bc271759/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:51:20.613595 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205420ec-929d-4487-b5e8-0f80ef44d8cb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.613889 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205420ec-929d-4487-b5e8-0f80ef44d8cb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.614170 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205420ec-929d-4487-b5e8-0f80ef44d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.646550 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-205420ec-929d-4487-b5e8-0f80ef44d8cb None None] MFA Rules not processed for user `48319f049a61404da7b56970bc271759`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:20.647858 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-205420ec-929d-4487-b5e8-0f80ef44d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:20.719696 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1464/2911] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:20.720944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11df3f-a7ba-46aa-a33f-95ff0939a500 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:20.791468 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11df3f-a7ba-46aa-a33f-95ff0939a500 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.796504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd15868-13f6-4764-a809-54b36394aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.797190 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd15868-13f6-4764-a809-54b36394aa88 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.797532 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd15868-13f6-4764-a809-54b36394aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.797812 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd15868-13f6-4764-a809-54b36394aa88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.798444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd15868-13f6-4764-a809-54b36394aa88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.800347 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd15868-13f6-4764-a809-54b36394aa88 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:20.810099 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:20.909613 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1448/2912] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:51:20 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:20.913805 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205420ec-929d-4487-b5e8-0f80ef44d8cb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:20.925071 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205420ec-929d-4487-b5e8-0f80ef44d8cb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:20.966223 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:20.986109 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd8a3c-ef78-4033-b9c6-e5deab66337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:20.986972 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8a3c-ef78-4033-b9c6-e5deab66337b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:20.987256 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8a3c-ef78-4033-b9c6-e5deab66337b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:20.987552 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd8a3c-ef78-4033-b9c6-e5deab66337b admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:20.988203 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd8a3c-ef78-4033-b9c6-e5deab66337b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:20.990172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd8a3c-ef78-4033-b9c6-e5deab66337b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:21.098641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1465/2913] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:51:20 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:51:21.102669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd15868-13f6-4764-a809-54b36394aa88 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:21.113343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd15868-13f6-4764-a809-54b36394aa88 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:21.118270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf237-f87e-45bb-9d66-72e6bfc6bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:21.118896 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf237-f87e-45bb-9d66-72e6bfc6bf19 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:21.119194 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf237-f87e-45bb-9d66-72e6bfc6bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:21.119463 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf237-f87e-45bb-9d66-72e6bfc6bf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:21.120095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bf237-f87e-45bb-9d66-72e6bfc6bf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:21.121701 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bf237-f87e-45bb-9d66-72e6bfc6bf19 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:21.133286 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1449/2914] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:21.138484 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd8a3c-ef78-4033-b9c6-e5deab66337b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:21.149566 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd8a3c-ef78-4033-b9c6-e5deab66337b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:21.154189 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308af79-ae30-4081-bb88-2ec1323c831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:21.154839 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308af79-ae30-4081-bb88-2ec1323c831d admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:21.155122 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308af79-ae30-4081-bb88-2ec1323c831d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:21.155399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308af79-ae30-4081-bb88-2ec1323c831d admin admin] PATH_INFO: `/v3/projects/467b4ca167c54ec1aff0922bb575bf0e/users/41feb65ce1734348887a8f4d220831dc/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:21.170569 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308af79-ae30-4081-bb88-2ec1323c831d admin admin] RBAC: Authorizing `identity:create_grant(project_id=467b4ca167c54ec1aff0922bb575bf0e, user_id=41feb65ce1734348887a8f4d220831dc, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:21.173471 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308af79-ae30-4081-bb88-2ec1323c831d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:21.263776 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1466/2915] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:21 2022] PUT /identity/v3/projects/467b4ca167c54ec1aff0922bb575bf0e/users/41feb65ce1734348887a8f4d220831dc/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:21.269839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf237-f87e-45bb-9d66-72e6bfc6bf19 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:21.279685 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf237-f87e-45bb-9d66-72e6bfc6bf19 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:21.335444 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cb120-06d1-4c07-b827-d52b478b3a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:21.336078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cb120-06d1-4c07-b827-d52b478b3a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:21.336430 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cb120-06d1-4c07-b827-d52b478b3a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:21.336736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cb120-06d1-4c07-b827-d52b478b3a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:21.337364 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cb120-06d1-4c07-b827-d52b478b3a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:21.338933 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cb120-06d1-4c07-b827-d52b478b3a00 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:21.348857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1450/2916] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:51:21.353035 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308af79-ae30-4081-bb88-2ec1323c831d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:21.364263 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308af79-ae30-4081-bb88-2ec1323c831d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:21.368956 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:21.369601 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:21.369883 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:21.370159 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] PATH_INFO: `/v3/projects/467b4ca167c54ec1aff0922bb575bf0e/users/41feb65ce1734348887a8f4d220831dc/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:21.372082 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467b4ca167c54ec1aff0922bb575bf0e, user_id=41feb65ce1734348887a8f4d220831dc, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:21.375287 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:21.385659 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1467/2917] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:21 2022] PUT /identity/v3/projects/467b4ca167c54ec1aff0922bb575bf0e/users/41feb65ce1734348887a8f4d220831dc/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:21.397546 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a54c-cb32-490c-968d-34a6de1e9b60 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:21.397836 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a54c-cb32-490c-968d-34a6de1e9b60 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:21.400691 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a54c-cb32-490c-968d-34a6de1e9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:21.427538 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6032a54c-cb32-490c-968d-34a6de1e9b60 None None] MFA Rules not processed for user `41feb65ce1734348887a8f4d220831dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:21.428819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6032a54c-cb32-490c-968d-34a6de1e9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:21.496736 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1451/2918] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:21.508088 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:21.509968 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:21.567863 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a9e83-7093-4866-b912-be2b66a727c3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:21.571526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45967ead-a48a-458d-981e-152998cb367d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:21.572133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967ead-a48a-458d-981e-152998cb367d service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:21.572417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967ead-a48a-458d-981e-152998cb367d service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:21.572732 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967ead-a48a-458d-981e-152998cb367d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:21.581880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45967ead-a48a-458d-981e-152998cb367d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:21.583313 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45967ead-a48a-458d-981e-152998cb367d service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:21.592669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1468/2919] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:22.856141 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a54c-cb32-490c-968d-34a6de1e9b60 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:22.919547 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a54c-cb32-490c-968d-34a6de1e9b60 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:22.924122 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:22.924777 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:22.925059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:22.925331 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] PATH_INFO: `/v3/users/48319f049a61404da7b56970bc271759` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:22.926485 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48319f049a61404da7b56970bc271759)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:22.928381 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:22.929907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:23.168705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48319f049a61404da7b56970bc271759'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:23.175922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48319f049a61404da7b56970bc271759'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:23.187800 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48319f049a61404da7b56970bc271759'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:23.269384 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48319f049a61404da7b56970bc271759'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:23.270025 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48319f049a61404da7b56970bc271759'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:23.276682 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1452/2920] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:22 2022] DELETE /identity/v3/users/48319f049a61404da7b56970bc271759 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:23.281271 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4480250-9877-4030-b5c8-2dfd9bd91cb1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:23.281933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4480250-9877-4030-b5c8-2dfd9bd91cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:23.281933 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4480250-9877-4030-b5c8-2dfd9bd91cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:23.302321 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f4480250-9877-4030-b5c8-2dfd9bd91cb1 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:23.303534 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f4480250-9877-4030-b5c8-2dfd9bd91cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:23.363110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1469/2921] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:51:23.372839 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:23.374274 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:23.431773 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171b32-bd27-4bf7-99bd-7860ad653cf4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:23.435234 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596ab90-2cf2-4bbf-af0e-e27bcf0e223a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:23.435826 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596ab90-2cf2-4bbf-af0e-e27bcf0e223a service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:23.436101 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596ab90-2cf2-4bbf-af0e-e27bcf0e223a service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:23.436369 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596ab90-2cf2-4bbf-af0e-e27bcf0e223a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:23.445639 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596ab90-2cf2-4bbf-af0e-e27bcf0e223a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:23.447037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596ab90-2cf2-4bbf-af0e-e27bcf0e223a service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:23.457006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1453/2922] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:23.925690 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4480250-9877-4030-b5c8-2dfd9bd91cb1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:23.927069 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f4480250-9877-4030-b5c8-2dfd9bd91cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:23.942733 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4480250-9877-4030-b5c8-2dfd9bd91cb1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:23.947726 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:23.948361 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:23.948697 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:23.949004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] PATH_INFO: `/v3/projects/60597d60587d4f728853bdd72ba68a07` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:23.950084 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=60597d60587d4f728853bdd72ba68a07)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:23.951973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:24.054683 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:24.069161 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60597d60587d4f728853bdd72ba68a07', 'request_id': 'req-595a57e9-2c5f-452d-aac3-0651269fe2ec'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.074740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60597d60587d4f728853bdd72ba68a07', 'request_id': 'req-595a57e9-2c5f-452d-aac3-0651269fe2ec'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.081662 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60597d60587d4f728853bdd72ba68a07', 'request_id': 'req-595a57e9-2c5f-452d-aac3-0651269fe2ec'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.183233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] The token cache is being invalidate because project 60597d60587d4f728853bdd72ba68a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:24.183525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.184200 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.185735 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1470/2923] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:23 2022] DELETE /identity/v3/projects/60597d60587d4f728853bdd72ba68a07 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:24.190705 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596ab90-2cf2-4bbf-af0e-e27bcf0e223a service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:24.200391 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596ab90-2cf2-4bbf-af0e-e27bcf0e223a service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:24.255968 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:24.256617 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:24.256907 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:24.257186 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] PATH_INFO: `/v3/users/41feb65ce1734348887a8f4d220831dc` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:24.258312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41feb65ce1734348887a8f4d220831dc)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:24.260329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:24.283143 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:24.489111 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41feb65ce1734348887a8f4d220831dc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.495937 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41feb65ce1734348887a8f4d220831dc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.508505 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41feb65ce1734348887a8f4d220831dc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.600171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41feb65ce1734348887a8f4d220831dc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.600849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-af2f898f-634b-415b-979d-b57fd6dea698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41feb65ce1734348887a8f4d220831dc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:24.607373 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1454/2924] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:24 2022] DELETE /identity/v3/users/41feb65ce1734348887a8f4d220831dc => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:25.059474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:25.063917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:25.080665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a57e9-2c5f-452d-aac3-0651269fe2ec admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:25.137718 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:25.138347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.138618 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.138885 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] PATH_INFO: `/v3/projects/467b4ca167c54ec1aff0922bb575bf0e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.139982 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467b4ca167c54ec1aff0922bb575bf0e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:25.142797 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:25.275081 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467b4ca167c54ec1aff0922bb575bf0e', 'request_id': 'req-7e909fb6-ba45-413f-9df6-55f60bfe1786'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:25.280582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467b4ca167c54ec1aff0922bb575bf0e', 'request_id': 'req-7e909fb6-ba45-413f-9df6-55f60bfe1786'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:25.287386 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467b4ca167c54ec1aff0922bb575bf0e', 'request_id': 'req-7e909fb6-ba45-413f-9df6-55f60bfe1786'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:25.392417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] The token cache is being invalidate because project 467b4ca167c54ec1aff0922bb575bf0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:25.392828 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:25.393474 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7e909fb6-ba45-413f-9df6-55f60bfe1786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:25.395227 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1471/2925] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:25 2022] DELETE /identity/v3/projects/467b4ca167c54ec1aff0922bb575bf0e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:25.399921 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e787b8-255a-40f2-b569-3f3215bb9ebc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.400338 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e787b8-255a-40f2-b569-3f3215bb9ebc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.400504 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e787b8-255a-40f2-b569-3f3215bb9ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.420068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-01e787b8-255a-40f2-b569-3f3215bb9ebc None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:25.421301 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-01e787b8-255a-40f2-b569-3f3215bb9ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:25.479672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1455/2926] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:25.487441 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50f381-5ba8-4e37-898e-20773733e66e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.487729 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50f381-5ba8-4e37-898e-20773733e66e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.488006 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50f381-5ba8-4e37-898e-20773733e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.508121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8e50f381-5ba8-4e37-898e-20773733e66e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:25.509406 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8e50f381-5ba8-4e37-898e-20773733e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:25.518239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1472/2927] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:25.522431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e787b8-255a-40f2-b569-3f3215bb9ebc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:25.532008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e787b8-255a-40f2-b569-3f3215bb9ebc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:25.536654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:25.537254 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.537533 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.537808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.538488 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:51:25.538790 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:25.540367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:25.552332 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1456/2928] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:51:25.556628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50f381-5ba8-4e37-898e-20773733e66e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:25.566468 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50f381-5ba8-4e37-898e-20773733e66e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:25.571207 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c78a0-754b-49ee-819f-264374ba2042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:25.573581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c78a0-754b-49ee-819f-264374ba2042 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.573581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c78a0-754b-49ee-819f-264374ba2042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.573581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c78a0-754b-49ee-819f-264374ba2042 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.573581 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c78a0-754b-49ee-819f-264374ba2042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:25.574910 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c78a0-754b-49ee-819f-264374ba2042 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:25.694132 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1473/2929] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:51:25 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:25.698313 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:25.709801 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd25a8-37b5-4b9d-b292-e7a77c58f39d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:25.769972 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46df1d-9c30-46a8-b142-48aec15e3d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:25.770585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46df1d-9c30-46a8-b142-48aec15e3d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.770864 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46df1d-9c30-46a8-b142-48aec15e3d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.771138 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46df1d-9c30-46a8-b142-48aec15e3d6e admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.771772 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46df1d-9c30-46a8-b142-48aec15e3d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:25.773718 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46df1d-9c30-46a8-b142-48aec15e3d6e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:25.907988 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1457/2930] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:51:25 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:25.912458 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c78a0-754b-49ee-819f-264374ba2042 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:25.923396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c78a0-754b-49ee-819f-264374ba2042 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:25.928133 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a042-3328-4574-b232-43e9b88d3363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:25.928771 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a042-3328-4574-b232-43e9b88d3363 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.929087 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a042-3328-4574-b232-43e9b88d3363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.929364 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a042-3328-4574-b232-43e9b88d3363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.930004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5a042-3328-4574-b232-43e9b88d3363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:25.931587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5a042-3328-4574-b232-43e9b88d3363 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:25.941918 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1474/2931] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:25.945986 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46df1d-9c30-46a8-b142-48aec15e3d6e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:25.956098 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46df1d-9c30-46a8-b142-48aec15e3d6e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:25.960819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9ab45-d3e2-445c-b53e-de070de51504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:25.961443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ab45-d3e2-445c-b53e-de070de51504 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.961728 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ab45-d3e2-445c-b53e-de070de51504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.962006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ab45-d3e2-445c-b53e-de070de51504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.962646 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9ab45-d3e2-445c-b53e-de070de51504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:25.964226 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9ab45-d3e2-445c-b53e-de070de51504 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:25.974971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1458/2932] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:25.978986 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a042-3328-4574-b232-43e9b88d3363 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:25.989326 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a042-3328-4574-b232-43e9b88d3363 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:25.993802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:25.994443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:25.994724 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:25.995024 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] PATH_INFO: `/v3/projects/a97a006635a641fda6748022329e9a4f/users/45e53427063548fc9fad1334924a0c5b/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:25.998036 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:26.010525 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97a006635a641fda6748022329e9a4f, user_id=45e53427063548fc9fad1334924a0c5b, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:26.013286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:26.080837 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1475/2933] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:25 2022] PUT /identity/v3/projects/a97a006635a641fda6748022329e9a4f/users/45e53427063548fc9fad1334924a0c5b/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:26.091844 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0038-2385-438f-a83a-b06883798bf1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:26.092135 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0038-2385-438f-a83a-b06883798bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:26.092416 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0038-2385-438f-a83a-b06883798bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:26.105664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:26.123495 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ec3d0038-2385-438f-a83a-b06883798bf1 None None] MFA Rules not processed for user `45e53427063548fc9fad1334924a0c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:26.125053 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ec3d0038-2385-438f-a83a-b06883798bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:26.198846 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1459/2934] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:26.210754 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:26.212443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:26.270370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908145-3959-47c3-9fc6-62df805cd4ad admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:26.273930 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35892fb5-7271-4f38-909f-0ef4fb460837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:26.274526 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892fb5-7271-4f38-909f-0ef4fb460837 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:26.274803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892fb5-7271-4f38-909f-0ef4fb460837 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:26.275073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892fb5-7271-4f38-909f-0ef4fb460837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:26.283770 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35892fb5-7271-4f38-909f-0ef4fb460837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:26.285239 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35892fb5-7271-4f38-909f-0ef4fb460837 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:26.293840 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1476/2935] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:26.313727 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0038-2385-438f-a83a-b06883798bf1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:26.374339 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0038-2385-438f-a83a-b06883798bf1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:26.378860 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:26.379479 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:26.379789 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:26.380061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] PATH_INFO: `/v3/users/45e53427063548fc9fad1334924a0c5b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:26.381218 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e53427063548fc9fad1334924a0c5b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:26.383112 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:26.578197 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e53427063548fc9fad1334924a0c5b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:26.585786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e53427063548fc9fad1334924a0c5b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:26.598208 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e53427063548fc9fad1334924a0c5b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:26.677985 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e53427063548fc9fad1334924a0c5b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:26.678625 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e53427063548fc9fad1334924a0c5b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:26.685075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1460/2936] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:26 2022] DELETE /identity/v3/users/45e53427063548fc9fad1334924a0c5b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:26.689989 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597529-dfd9-422c-8f21-ddeffe39a3ea None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:26.690273 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597529-dfd9-422c-8f21-ddeffe39a3ea None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:26.690606 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597529-dfd9-422c-8f21-ddeffe39a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:26.710370 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fb597529-dfd9-422c-8f21-ddeffe39a3ea None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:26.711653 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb597529-dfd9-422c-8f21-ddeffe39a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:26.770442 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1477/2937] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:26.780272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:26.781920 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:26.802078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:26.840370 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dbe07-8454-4061-8ac4-4772ccf1516d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:26.843943 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6e755-bab2-4d89-a04b-396806487ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:26.844585 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6e755-bab2-4d89-a04b-396806487ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:26.845514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6e755-bab2-4d89-a04b-396806487ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:26.846055 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6e755-bab2-4d89-a04b-396806487ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:26.855106 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6e755-bab2-4d89-a04b-396806487ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:26.856567 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6e755-bab2-4d89-a04b-396806487ce5 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:26.866162 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1461/2938] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:27.287880 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb597529-dfd9-422c-8f21-ddeffe39a3ea None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:27.289451 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb597529-dfd9-422c-8f21-ddeffe39a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:27.304607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb597529-dfd9-422c-8f21-ddeffe39a3ea None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:27.309380 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:27.310640 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:27.310935 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:27.311558 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] PATH_INFO: `/v3/projects/a97a006635a641fda6748022329e9a4f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:27.312855 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97a006635a641fda6748022329e9a4f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:27.315557 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:27.416093 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97a006635a641fda6748022329e9a4f', 'request_id': 'req-2358e82c-e9a8-4d9d-be16-498d9778bd04'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:27.421632 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97a006635a641fda6748022329e9a4f', 'request_id': 'req-2358e82c-e9a8-4d9d-be16-498d9778bd04'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:27.428628 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97a006635a641fda6748022329e9a4f', 'request_id': 'req-2358e82c-e9a8-4d9d-be16-498d9778bd04'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:27.528816 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] The token cache is being invalidate because project a97a006635a641fda6748022329e9a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:27.529110 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:27.529737 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2358e82c-e9a8-4d9d-be16-498d9778bd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:27.531260 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1478/2939] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:27 2022] DELETE /identity/v3/projects/a97a006635a641fda6748022329e9a4f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:27.536496 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ddf8-192a-45f8-a4f0-fefd70e8c59e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:27.536787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ddf8-192a-45f8-a4f0-fefd70e8c59e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:27.537061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ddf8-192a-45f8-a4f0-fefd70e8c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:27.558004 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1269ddf8-192a-45f8-a4f0-fefd70e8c59e None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:27.559285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1269ddf8-192a-45f8-a4f0-fefd70e8c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:27.618148 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1462/2940] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:27.626459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f47f7-9da7-4fbf-8ee9-000278173728 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:27.626759 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f47f7-9da7-4fbf-8ee9-000278173728 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:27.627038 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f47f7-9da7-4fbf-8ee9-000278173728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:27.648073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-420f47f7-9da7-4fbf-8ee9-000278173728 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:27.649315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-420f47f7-9da7-4fbf-8ee9-000278173728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:27.658025 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1479/2941] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:27.662390 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ddf8-192a-45f8-a4f0-fefd70e8c59e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:27.672059 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ddf8-192a-45f8-a4f0-fefd70e8c59e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:27.677198 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:27.677803 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:27.678084 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:27.678358 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:27.679006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:51:27.679312 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:27.680940 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:27.692441 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1463/2942] 10.222.0.75 () {58 vars in 1153 bytes} [Mon Sep 19 15:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:51:27.696835 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f47f7-9da7-4fbf-8ee9-000278173728 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:27.702417 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:27.706237 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f47f7-9da7-4fbf-8ee9-000278173728 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:27.710903 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70953f-5617-4796-ab8a-df0520848b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:27.713404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70953f-5617-4796-ab8a-df0520848b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:27.713404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70953f-5617-4796-ab8a-df0520848b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:27.713404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70953f-5617-4796-ab8a-df0520848b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:27.713404 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70953f-5617-4796-ab8a-df0520848b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:27.714686 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70953f-5617-4796-ab8a-df0520848b02 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:27.800216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1480/2943] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:51:27 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:27.804576 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:27.814431 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c594d5-4d27-4213-9579-69448cdba3d4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:27.869719 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b123f7-c91b-4a04-8515-ad31addf8460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:27.870319 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b123f7-c91b-4a04-8515-ad31addf8460 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:27.870612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b123f7-c91b-4a04-8515-ad31addf8460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:27.870885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b123f7-c91b-4a04-8515-ad31addf8460 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:27.871499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b123f7-c91b-4a04-8515-ad31addf8460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:27.873424 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b123f7-c91b-4a04-8515-ad31addf8460 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:27.954989 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1464/2944] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:51:27 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:27.959175 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70953f-5617-4796-ab8a-df0520848b02 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:27.970209 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70953f-5617-4796-ab8a-df0520848b02 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:27.974973 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33008c0-03dd-408f-873e-83a282917377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:27.975572 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33008c0-03dd-408f-873e-83a282917377 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:27.975851 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33008c0-03dd-408f-873e-83a282917377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:27.976121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33008c0-03dd-408f-873e-83a282917377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:27.976792 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33008c0-03dd-408f-873e-83a282917377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:27.978377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33008c0-03dd-408f-873e-83a282917377 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:27.991154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1481/2945] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:27.995168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b123f7-c91b-4a04-8515-ad31addf8460 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:28.005386 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b123f7-c91b-4a04-8515-ad31addf8460 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:28.010007 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0b95-769e-4e51-922c-37c229ffd0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:28.010606 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0b95-769e-4e51-922c-37c229ffd0ad admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.010885 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0b95-769e-4e51-922c-37c229ffd0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.011160 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0b95-769e-4e51-922c-37c229ffd0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.011797 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e0b95-769e-4e51-922c-37c229ffd0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:28.013395 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e0b95-769e-4e51-922c-37c229ffd0ad admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:28.024922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1465/2946] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:28.029029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33008c0-03dd-408f-873e-83a282917377 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:28.039784 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33008c0-03dd-408f-873e-83a282917377 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:28.044521 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a784e4-afcf-4063-8c35-42c0c5698e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:28.045178 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a784e4-afcf-4063-8c35-42c0c5698e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.045486 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a784e4-afcf-4063-8c35-42c0c5698e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.045746 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a784e4-afcf-4063-8c35-42c0c5698e82 admin admin] PATH_INFO: `/v3/projects/c3432aff03f04a96b8aaa989d20e4959/users/7334c70cee29402e98c53b3264215d90/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.060593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a784e4-afcf-4063-8c35-42c0c5698e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3432aff03f04a96b8aaa989d20e4959, user_id=7334c70cee29402e98c53b3264215d90, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:28.063253 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a784e4-afcf-4063-8c35-42c0c5698e82 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:28.149340 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1482/2947] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:28 2022] PUT /identity/v3/projects/c3432aff03f04a96b8aaa989d20e4959/users/7334c70cee29402e98c53b3264215d90/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:28.160168 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f9a2-c26a-4831-9c7a-187dea503e7d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.160457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f9a2-c26a-4831-9c7a-187dea503e7d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.160769 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f9a2-c26a-4831-9c7a-187dea503e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.187924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-df56f9a2-c26a-4831-9c7a-187dea503e7d None None] MFA Rules not processed for user `7334c70cee29402e98c53b3264215d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:28.189638 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df56f9a2-c26a-4831-9c7a-187dea503e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:28.201757 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:28.256857 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1466/2948] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:28.261300 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a784e4-afcf-4063-8c35-42c0c5698e82 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:28.323153 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a784e4-afcf-4063-8c35-42c0c5698e82 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:28.327692 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72aab59-2195-454d-ad87-ce27e4b1c706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:28.328285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72aab59-2195-454d-ad87-ce27e4b1c706 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.328593 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72aab59-2195-454d-ad87-ce27e4b1c706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.328865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72aab59-2195-454d-ad87-ce27e4b1c706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.330135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72aab59-2195-454d-ad87-ce27e4b1c706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:28.332023 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72aab59-2195-454d-ad87-ce27e4b1c706 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:28.429917 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1483/2949] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:51:28 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:28.434125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f9a2-c26a-4831-9c7a-187dea503e7d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:28.445220 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f9a2-c26a-4831-9c7a-187dea503e7d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:28.502152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990c5e-25e4-4657-955b-a86354e84ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:28.502786 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990c5e-25e4-4657-955b-a86354e84ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.503075 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990c5e-25e4-4657-955b-a86354e84ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.503351 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba990c5e-25e4-4657-955b-a86354e84ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.503978 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba990c5e-25e4-4657-955b-a86354e84ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:28.505980 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba990c5e-25e4-4657-955b-a86354e84ab0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:28.589094 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1467/2950] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:51:28 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:28.593075 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72aab59-2195-454d-ad87-ce27e4b1c706 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:28.603443 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72aab59-2195-454d-ad87-ce27e4b1c706 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:28.608108 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851ed38-7f74-47a8-b64a-b0256dd7e5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:28.608740 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851ed38-7f74-47a8-b64a-b0256dd7e5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.609021 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851ed38-7f74-47a8-b64a-b0256dd7e5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.609296 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851ed38-7f74-47a8-b64a-b0256dd7e5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.609937 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851ed38-7f74-47a8-b64a-b0256dd7e5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:28.611731 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851ed38-7f74-47a8-b64a-b0256dd7e5a5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:28.622277 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1484/2951] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:28.629227 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990c5e-25e4-4657-955b-a86354e84ab0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:28.639196 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba990c5e-25e4-4657-955b-a86354e84ab0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:28.648702 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4a421-7882-4578-b762-8718d7bef264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:28.649317 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a421-7882-4578-b762-8718d7bef264 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.649603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a421-7882-4578-b762-8718d7bef264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.649880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a421-7882-4578-b762-8718d7bef264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.650575 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4a421-7882-4578-b762-8718d7bef264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:28.652165 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4a421-7882-4578-b762-8718d7bef264 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:28.665367 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1468/2952] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:28.669514 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851ed38-7f74-47a8-b64a-b0256dd7e5a5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:28.679665 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851ed38-7f74-47a8-b64a-b0256dd7e5a5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:28.684315 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fb154-8f6c-4986-b9ef-2d5b40690494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:28.684993 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb154-8f6c-4986-b9ef-2d5b40690494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.685274 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb154-8f6c-4986-b9ef-2d5b40690494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.685549 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb154-8f6c-4986-b9ef-2d5b40690494 admin admin] PATH_INFO: `/v3/projects/4d6b80e37a724a8e9f5ea76d0646af6e/users/14379817189e4a81bef914c20deb925c/roles/943b210730ce4efdaa3903233fba5962` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.700611 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fb154-8f6c-4986-b9ef-2d5b40690494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6b80e37a724a8e9f5ea76d0646af6e, user_id=14379817189e4a81bef914c20deb925c, role_id=943b210730ce4efdaa3903233fba5962)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:28.703310 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fb154-8f6c-4986-b9ef-2d5b40690494 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:28.792897 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1485/2953] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:28 2022] PUT /identity/v3/projects/4d6b80e37a724a8e9f5ea76d0646af6e/users/14379817189e4a81bef914c20deb925c/roles/943b210730ce4efdaa3903233fba5962 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:28.804938 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136e35c-10d9-4c4c-b432-afeedc75e1b1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.805230 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136e35c-10d9-4c4c-b432-afeedc75e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.805506 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136e35c-10d9-4c4c-b432-afeedc75e1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.834299 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1136e35c-10d9-4c4c-b432-afeedc75e1b1 None None] MFA Rules not processed for user `14379817189e4a81bef914c20deb925c`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:28.835498 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1136e35c-10d9-4c4c-b432-afeedc75e1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:28.902435 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1469/2954] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:28.906932 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fb154-8f6c-4986-b9ef-2d5b40690494 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:28.967211 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:28.970802 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fb154-8f6c-4986-b9ef-2d5b40690494 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:28.975669 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df03f9-2998-4e44-8de4-2e227b0d56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:28.980864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df03f9-2998-4e44-8de4-2e227b0d56f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:28.980864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df03f9-2998-4e44-8de4-2e227b0d56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:28.980864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df03f9-2998-4e44-8de4-2e227b0d56f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:28.980864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df03f9-2998-4e44-8de4-2e227b0d56f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:28.980864 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df03f9-2998-4e44-8de4-2e227b0d56f7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:29.153673 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1486/2955] 10.222.0.75 () {60 vars in 1153 bytes} [Mon Sep 19 15:51:28 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:51:29.158360 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136e35c-10d9-4c4c-b432-afeedc75e1b1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:29.168999 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136e35c-10d9-4c4c-b432-afeedc75e1b1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:29.187341 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:29.225945 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99af835-06d0-4cf7-b0a4-8c35e2043bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:29.226551 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af835-06d0-4cf7-b0a4-8c35e2043bba admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:29.226831 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af835-06d0-4cf7-b0a4-8c35e2043bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:29.227103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af835-06d0-4cf7-b0a4-8c35e2043bba admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:29.227793 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99af835-06d0-4cf7-b0a4-8c35e2043bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:29.230276 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99af835-06d0-4cf7-b0a4-8c35e2043bba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:29.303672 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1470/2956] 10.222.0.75 () {60 vars in 1144 bytes} [Mon Sep 19 15:51:29 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:51:29.307706 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df03f9-2998-4e44-8de4-2e227b0d56f7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:29.318590 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df03f9-2998-4e44-8de4-2e227b0d56f7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:29.323249 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d64e-7896-45a1-ae37-add3b2eff8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:29.323844 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d64e-7896-45a1-ae37-add3b2eff8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:29.324121 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d64e-7896-45a1-ae37-add3b2eff8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:29.324418 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d64e-7896-45a1-ae37-add3b2eff8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:29.325154 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7d64e-7896-45a1-ae37-add3b2eff8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:29.326751 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7d64e-7896-45a1-ae37-add3b2eff8a1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:29.337222 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1487/2957] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:29.341298 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99af835-06d0-4cf7-b0a4-8c35e2043bba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:29.351693 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99af835-06d0-4cf7-b0a4-8c35e2043bba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:29.356225 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a33b1f-9063-42dc-9d9f-0ead53285f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:29.356904 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a33b1f-9063-42dc-9d9f-0ead53285f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:29.357185 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a33b1f-9063-42dc-9d9f-0ead53285f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:29.357457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a33b1f-9063-42dc-9d9f-0ead53285f98 admin admin] PATH_INFO: `/v3/projects/5392fbd072424c84b1e44707be700116/users/b714db279c1749b9bf2ccf42ecc5415a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:29.372388 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a33b1f-9063-42dc-9d9f-0ead53285f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5392fbd072424c84b1e44707be700116, user_id=b714db279c1749b9bf2ccf42ecc5415a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:29.375037 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a33b1f-9063-42dc-9d9f-0ead53285f98 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:29.429499 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1471/2958] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:29 2022] PUT /identity/v3/projects/5392fbd072424c84b1e44707be700116/users/b714db279c1749b9bf2ccf42ecc5415a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:51:29.433428 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d64e-7896-45a1-ae37-add3b2eff8a1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:29.443629 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d64e-7896-45a1-ae37-add3b2eff8a1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:29.499675 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542fd13-8544-4ddc-a643-acba11d6c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:29.500276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fd13-8544-4ddc-a643-acba11d6c588 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:29.500587 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fd13-8544-4ddc-a643-acba11d6c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:29.500865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fd13-8544-4ddc-a643-acba11d6c588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:29.501528 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542fd13-8544-4ddc-a643-acba11d6c588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:29.503115 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542fd13-8544-4ddc-a643-acba11d6c588 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:29.515964 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1488/2959] 10.222.0.75 () {58 vars in 1122 bytes} [Mon Sep 19 15:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:51:29.518125 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a33b1f-9063-42dc-9d9f-0ead53285f98 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:29.528421 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a33b1f-9063-42dc-9d9f-0ead53285f98 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:29.534036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:29.534690 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:29.534974 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:29.538808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] PATH_INFO: `/v3/projects/5392fbd072424c84b1e44707be700116/users/b714db279c1749b9bf2ccf42ecc5415a/roles/0bfe1c3e776e4192a1fac501682555a6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:29.538808 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5392fbd072424c84b1e44707be700116, user_id=b714db279c1749b9bf2ccf42ecc5415a, role_id=0bfe1c3e776e4192a1fac501682555a6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:29.539870 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:29.550796 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1472/2960] 10.222.0.75 () {60 vars in 1483 bytes} [Mon Sep 19 15:51:29 2022] PUT /identity/v3/projects/5392fbd072424c84b1e44707be700116/users/b714db279c1749b9bf2ccf42ecc5415a/roles/0bfe1c3e776e4192a1fac501682555a6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:29.560944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02df554-8e30-46a7-a89d-3dc1ce07c3e0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:29.561286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02df554-8e30-46a7-a89d-3dc1ce07c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:29.561607 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02df554-8e30-46a7-a89d-3dc1ce07c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:29.591859 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b02df554-8e30-46a7-a89d-3dc1ce07c3e0 None None] MFA Rules not processed for user `b714db279c1749b9bf2ccf42ecc5415a`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:29.593136 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b02df554-8e30-46a7-a89d-3dc1ce07c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:29.662494 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1489/2961] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:29.674669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:29.676423 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:29.734654 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135a44f-bdb8-40d3-b253-b18326afee61 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:29.739067 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28fe32-2eb9-4cf1-96f9-fc243589c7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:29.739664 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28fe32-2eb9-4cf1-96f9-fc243589c7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:29.739944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28fe32-2eb9-4cf1-96f9-fc243589c7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:29.740214 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28fe32-2eb9-4cf1-96f9-fc243589c7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:29.796850 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28fe32-2eb9-4cf1-96f9-fc243589c7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:29.798932 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28fe32-2eb9-4cf1-96f9-fc243589c7c0 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:29.807787 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1473/2962] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:31.731971 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02df554-8e30-46a7-a89d-3dc1ce07c3e0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:31.733399 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b02df554-8e30-46a7-a89d-3dc1ce07c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:31.745358 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02df554-8e30-46a7-a89d-3dc1ce07c3e0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:31.752865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a81bbe-08ff-4945-af74-624bdbeefce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:31.752865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a81bbe-08ff-4945-af74-624bdbeefce0 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:31.752865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a81bbe-08ff-4945-af74-624bdbeefce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:31.752865 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a81bbe-08ff-4945-af74-624bdbeefce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:31.799953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:31.808700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a81bbe-08ff-4945-af74-624bdbeefce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:31.810600 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a81bbe-08ff-4945-af74-624bdbeefce0 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:31.819575 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1490/2963] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:33.212756 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28fe32-2eb9-4cf1-96f9-fc243589c7c0 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:33.221603 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28fe32-2eb9-4cf1-96f9-fc243589c7c0 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:33.225223 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7116e2-d9dc-49b5-bf1e-17eca3dbebcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a203084e8c5d4cb6b258b2d39db4f9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:33.225819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7116e2-d9dc-49b5-bf1e-17eca3dbebcb service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:33.226103 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7116e2-d9dc-49b5-bf1e-17eca3dbebcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:33.226380 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7116e2-d9dc-49b5-bf1e-17eca3dbebcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:33.235134 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7116e2-d9dc-49b5-bf1e-17eca3dbebcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:33.236584 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7116e2-d9dc-49b5-bf1e-17eca3dbebcb service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:33.245849 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1474/2964] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:38.929145 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a81bbe-08ff-4945-af74-624bdbeefce0 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:38.990257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a81bbe-08ff-4945-af74-624bdbeefce0 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:38.994842 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:38.995473 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:38.995755 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:38.996031 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] PATH_INFO: `/v3/users/7334c70cee29402e98c53b3264215d90` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:38.997192 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7334c70cee29402e98c53b3264215d90)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:38.999124 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:39.242803 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7334c70cee29402e98c53b3264215d90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:39.255560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7334c70cee29402e98c53b3264215d90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:39.262609 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7334c70cee29402e98c53b3264215d90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:39.331888 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7334c70cee29402e98c53b3264215d90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:39.332510 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7334c70cee29402e98c53b3264215d90'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:39.338630 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1491/2965] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:38 2022] DELETE /identity/v3/users/7334c70cee29402e98c53b3264215d90 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:39.343474 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a653-446d-4c42-9584-c53afc201d44 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:39.343959 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a653-446d-4c42-9584-c53afc201d44 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:39.344078 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a653-446d-4c42-9584-c53afc201d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:39.364152 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1bb5a653-446d-4c42-9584-c53afc201d44 None None] MFA Rules not processed for user `46687a8108714da08b34f26401622753`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:51:39.365443 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1bb5a653-446d-4c42-9584-c53afc201d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:39.374486 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:39.425611 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1475/2966] 10.222.0.75 () {58 vars in 958 bytes} [Mon Sep 19 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:51:39.435561 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:39.437029 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:39.494818 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dae38-ed13-4932-9584-4ae3581ae275 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:39.498291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565742a-e494-4d88-a9e2-7e46b7563f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0bbf089504d408db0bb7055a780a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:39.498895 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565742a-e494-4d88-a9e2-7e46b7563f90 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:39.499172 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565742a-e494-4d88-a9e2-7e46b7563f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:39.499445 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565742a-e494-4d88-a9e2-7e46b7563f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:39.508944 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565742a-e494-4d88-a9e2-7e46b7563f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:39.510367 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565742a-e494-4d88-a9e2-7e46b7563f90 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:39.519995 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1492/2967] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:51:39.965502 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a653-446d-4c42-9584-c53afc201d44 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:39.967013 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1bb5a653-446d-4c42-9584-c53afc201d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:39.982971 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a653-446d-4c42-9584-c53afc201d44 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:39.988243 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:39.988950 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:39.989290 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:39.989497 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] PATH_INFO: `/v3/projects/c3432aff03f04a96b8aaa989d20e4959` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:39.990641 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3432aff03f04a96b8aaa989d20e4959)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:39.992570 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:40.101827 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3432aff03f04a96b8aaa989d20e4959', 'request_id': 'req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.171964 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3432aff03f04a96b8aaa989d20e4959', 'request_id': 'req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.178847 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3432aff03f04a96b8aaa989d20e4959', 'request_id': 'req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.189183 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] The token cache is being invalidate because project c3432aff03f04a96b8aaa989d20e4959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:40.189473 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.190095 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.191560 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1476/2968] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:39 2022] DELETE /identity/v3/projects/c3432aff03f04a96b8aaa989d20e4959 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:40.195541 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565742a-e494-4d88-a9e2-7e46b7563f90 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:40.205291 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565742a-e494-4d88-a9e2-7e46b7563f90 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:40.214953 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:40.263833 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:40.264460 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:40.264766 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:40.265039 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] PATH_INFO: `/v3/users/14379817189e4a81bef914c20deb925c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:40.266193 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14379817189e4a81bef914c20deb925c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:40.268415 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:40.440233 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14379817189e4a81bef914c20deb925c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.452868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14379817189e4a81bef914c20deb925c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.460743 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14379817189e4a81bef914c20deb925c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.509129 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14379817189e4a81bef914c20deb925c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.509760 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14379817189e4a81bef914c20deb925c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:40.516160 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1493/2969] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:40 2022] DELETE /identity/v3/users/14379817189e4a81bef914c20deb925c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:40.899677 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:40.901268 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:40.916669 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd4043-8d0d-40b6-afb1-7d21b3d101a9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:40.975120 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:40.975711 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:40.975995 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:40.976270 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] PATH_INFO: `/v3/projects/4d6b80e37a724a8e9f5ea76d0646af6e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:40.977420 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6b80e37a724a8e9f5ea76d0646af6e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:40.979321 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:41.072343 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:41.078406 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6b80e37a724a8e9f5ea76d0646af6e', 'request_id': 'req-81552265-a305-4893-987d-4651d13bd739'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.141083 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6b80e37a724a8e9f5ea76d0646af6e', 'request_id': 'req-81552265-a305-4893-987d-4651d13bd739'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.149003 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6b80e37a724a8e9f5ea76d0646af6e', 'request_id': 'req-81552265-a305-4893-987d-4651d13bd739'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.159671 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] The token cache is being invalidate because project 4d6b80e37a724a8e9f5ea76d0646af6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:41.159965 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.160660 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.162171 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1477/2970] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:40 2022] DELETE /identity/v3/projects/4d6b80e37a724a8e9f5ea76d0646af6e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:41.166396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:41.167983 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:41.180813 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a6a2-abd6-4fdf-baf1-0f6b625fdef5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:41.236868 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:41.238135 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:41.238327 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:41.238605 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] PATH_INFO: `/v3/users/b714db279c1749b9bf2ccf42ecc5415a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:41.239741 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b714db279c1749b9bf2ccf42ecc5415a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:41.241719 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:41.394767 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:41.403878 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b714db279c1749b9bf2ccf42ecc5415a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.415641 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b714db279c1749b9bf2ccf42ecc5415a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.422435 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b714db279c1749b9bf2ccf42ecc5415a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.475090 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b714db279c1749b9bf2ccf42ecc5415a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.475712 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0368ebbb-975d-4dd1-8d83-d741851cd51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b714db279c1749b9bf2ccf42ecc5415a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:41.482104 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1494/2971] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:51:41 2022] DELETE /identity/v3/users/b714db279c1749b9bf2ccf42ecc5415a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:41.891179 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:51:41.892879 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:51:41.907051 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552265-a305-4893-987d-4651d13bd739 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:51:41.967514 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:51:41.968139 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:51:41.968414 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:51:41.968709 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] PATH_INFO: `/v3/projects/5392fbd072424c84b1e44707be700116` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:51:41.969810 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5392fbd072424c84b1e44707be700116)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:51:41.971748 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:51:42.062961 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5392fbd072424c84b1e44707be700116', 'request_id': 'req-c438675a-1546-497c-ad68-682844ec55e0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:42.120219 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5392fbd072424c84b1e44707be700116', 'request_id': 'req-c438675a-1546-497c-ad68-682844ec55e0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:42.126458 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5392fbd072424c84b1e44707be700116', 'request_id': 'req-c438675a-1546-497c-ad68-682844ec55e0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:42.137996 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] The token cache is being invalidate because project 5392fbd072424c84b1e44707be700116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:51:42.138285 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:42.138941 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:51:42.140437 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1478/2972] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:51:41 2022] DELETE /identity/v3/projects/5392fbd072424c84b1e44707be700116 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:51:51.630216 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:52.134819 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:07.906831 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc041-a481-4dfc-a312-5576b14d7dda None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:53:07.907316 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc041-a481-4dfc-a312-5576b14d7dda None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:53:07.907421 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddc041-a481-4dfc-a312-5576b14d7dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:53:07.927019 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b4ddc041-a481-4dfc-a312-5576b14d7dda None None] MFA Rules not processed for user `0c8b9fb92f244a11a8dc082a9bee85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:53:07.928225 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b4ddc041-a481-4dfc-a312-5576b14d7dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:53:07.987574 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1495/2973] 10.222.0.75 () {58 vars in 967 bytes} [Mon Sep 19 15:53:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:53:08.031130 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:53:08.032563 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:53:08.148329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438675a-1546-497c-ad68-682844ec55e0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:53:08.155922 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad6f1167ee1d479ab3c0a5a8d46d846d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:53:08.156876 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:53:08.157294 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:53:08.157708 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:53:08.186005 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:53:08.191116 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:53:08.199815 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1479/2974] 10.222.0.75 () {60 vars in 1384 bytes} [Mon Sep 19 15:53:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:53:12.947459 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddc041-a481-4dfc-a312-5576b14d7dda None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:53:12.949373 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b4ddc041-a481-4dfc-a312-5576b14d7dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:53:13.040204 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddc041-a481-4dfc-a312-5576b14d7dda None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:53:13.046663 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:53:13.047286 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:53:13.047571 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:53:13.047845 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:53:13.049728 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:53:13.062396 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:53:13.064005 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:53:13.075010 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1496/2975] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:53:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:53:17.134782 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:53:17.136256 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:53:17.203107 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6b5f-15aa-4b43-a19a-6df25ce881fd service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:53:17.207673 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:53:17.208272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:53:17.208599 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:53:17.208880 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] PATH_INFO: `/v3/users/a4a0d76fa5a54a729b0e4862a6c88de7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:53:17.210006 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a0d76fa5a54a729b0e4862a6c88de7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:53:17.212668 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:53:17.362924 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a0d76fa5a54a729b0e4862a6c88de7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:17.370683 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a0d76fa5a54a729b0e4862a6c88de7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:17.383296 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a0d76fa5a54a729b0e4862a6c88de7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:17.439309 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a0d76fa5a54a729b0e4862a6c88de7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:17.439944 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a0d76fa5a54a729b0e4862a6c88de7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:17.447324 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1480/2976] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:53:17 2022] DELETE /identity/v3/users/a4a0d76fa5a54a729b0e4862a6c88de7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:53:17.699004 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:53:17.715099 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597ded-aa77-4f97-848b-364a54a51fc7 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:53:17.776285 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:53:17.777044 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:53:17.777500 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:53:17.777786 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] PATH_INFO: `/v3/projects/abac9835b5dd48248ba4f7d77ea8d7f5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:53:17.779028 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abac9835b5dd48248ba4f7d77ea8d7f5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:53:17.781378 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:53:17.895560 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:17.904425 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'request_id': 'req-b16093a8-3f24-4f12-9457-56d9b75b6954'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:17.910821 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'request_id': 'req-b16093a8-3f24-4f12-9457-56d9b75b6954'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:17.917976 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'request_id': 'req-b16093a8-3f24-4f12-9457-56d9b75b6954'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:17.999377 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] The token cache is being invalidate because project abac9835b5dd48248ba4f7d77ea8d7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:53:17.999582 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.000212 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.001700 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1497/2977] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:53:17 2022] DELETE /identity/v3/projects/abac9835b5dd48248ba4f7d77ea8d7f5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:53:18.006036 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:53:18.007543 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:53:18.021061 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c30fb-7f5d-473b-8dbd-47bc51cc1162 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:53:18.025746 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:18.078068 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:53:18.078710 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:53:18.078993 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:53:18.079272 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] PATH_INFO: `/v3/users/6dc5f56f47974d3a9e6ea5cc1cef613a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:53:18.080457 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc5f56f47974d3a9e6ea5cc1cef613a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:53:18.082401 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:53:18.294118 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc5f56f47974d3a9e6ea5cc1cef613a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.301310 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc5f56f47974d3a9e6ea5cc1cef613a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.313895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc5f56f47974d3a9e6ea5cc1cef613a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.371895 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc5f56f47974d3a9e6ea5cc1cef613a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.372577 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc5f56f47974d3a9e6ea5cc1cef613a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.379089 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1481/2978] 10.222.0.75 () {58 vars in 1224 bytes} [Mon Sep 19 15:53:18 2022] DELETE /identity/v3/users/6dc5f56f47974d3a9e6ea5cc1cef613a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:53:18.676217 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:53:18.677775 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:53:18.692073 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16093a8-3f24-4f12-9457-56d9b75b6954 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:53:18.764138 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46687a8108714da08b34f26401622753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9905c16dd71145d6a307772e4fe88d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:53:18.764824 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:53:18.765097 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:53:18.765374 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] PATH_INFO: `/v3/projects/5e2cc42bb5544198bcfa8617c7fccb73` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:53:18.767347 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2cc42bb5544198bcfa8617c7fccb73)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:53:18.769329 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:53:18.893257 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2cc42bb5544198bcfa8617c7fccb73', 'request_id': 'req-38d83740-a08e-439f-8eaf-d538c88536a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.900562 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2cc42bb5544198bcfa8617c7fccb73', 'request_id': 'req-38d83740-a08e-439f-8eaf-d538c88536a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.907276 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2cc42bb5544198bcfa8617c7fccb73', 'request_id': 'req-38d83740-a08e-439f-8eaf-d538c88536a4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.995030 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] The token cache is being invalidate because project 5e2cc42bb5544198bcfa8617c7fccb73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:53:18.998232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.998232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-38d83740-a08e-439f-8eaf-d538c88536a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:53:18.998232 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1498/2979] 10.222.0.75 () {58 vars in 1233 bytes} [Mon Sep 19 15:53:18 2022] DELETE /identity/v3/projects/5e2cc42bb5544198bcfa8617c7fccb73 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:53:28.375518 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:53:28.991149 dv-cinder-756711-11-iscsi devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:54:29.637008 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:54:29.638415 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:54:29.711553 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98937a4-f25e-4840-8d8a-57ad8faf4217 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:54:29.773378 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a414b0-1ae3-4799-b62d-035be25b3648 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e921d9249fb49d4ad9c94caa6691a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff25aa94bb840c1afb969d7b5c80d7c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:54:29.773997 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a414b0-1ae3-4799-b62d-035be25b3648 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:54:29.774302 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a414b0-1ae3-4799-b62d-035be25b3648 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:54:29.774597 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a414b0-1ae3-4799-b62d-035be25b3648 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:54:29.776329 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10a414b0-1ae3-4799-b62d-035be25b3648 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:54:29.788002 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a414b0-1ae3-4799-b62d-035be25b3648 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:54:29.789612 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a414b0-1ae3-4799-b62d-035be25b3648 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:54:29.799653 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1482/2980] 10.222.0.75 () {60 vars in 1365 bytes} [Mon Sep 19 15:54:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:54:39.795345 dv-cinder-756711-11-iscsi devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=58 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}